Sep 01 01:54:20 devstack cinder-volume[75804]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:54:20 devstack cinder-volume[75804]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:54:20 devstack cinder-volume[75804]: we strongly recommend against using it for new projects. Sep 01 01:54:20 devstack cinder-volume[75804]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:54:20 devstack cinder-volume[75804]: framework. For more detail see Sep 01 01:54:20 devstack cinder-volume[75804]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:54:20 devstack cinder-volume[75804]: import eventlet # noqa Sep 01 01:54:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:54:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:54:23 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:54:24 devstack cinder-volume[75804]: INFO dbcounter [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Registered counter for database cinder Sep 01 01:54:24 devstack cinder-volume[75804]: DEBUG oslo_db.sqlalchemy.engines [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:54:24 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writer thread running {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:54:24 devstack cinder-volume[75804]: INFO cinder.rpc [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:54:25 devstack cinder-volume[75804]: INFO cinder.rpc [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_db.sqlalchemy.engines [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:54:25 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Determined volume DB was empty at startup. Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG cinder.volume.manager [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75804) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:54:25 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:54:25 devstack cinder-volume[75804]: WARNING stevedore.named [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:54:25 devstack cinder-volume[75804]: WARNING castellan.key_manager [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:54:25 devstack cinder-volume[75804]: WARNING cinder.keymgr.conf_key_mgr [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG cinder.volume.drivers.lvm [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75804) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_concurrency.processutils [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] CMD "cinder-rtstool verify" returned: 0 in 0.543s {{(pid=75804) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_db.sqlalchemy.engines [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:54:25 devstack cinder-volume[75804]: INFO cinder.rpc [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 01:54:25 devstack cinder-volume[75804]: INFO cinder.rpc [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 01:54:25 devstack cinder-volume[75804]: WARNING stevedore.named [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:54:25 devstack cinder-volume[75804]: WARNING castellan.key_manager [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:54:25 devstack cinder-volume[75804]: INFO cinder.volume.manager [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_db.sqlalchemy.engines [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75804) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:54:25 devstack cinder-volume[75804]: INFO oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Starting 1 workers Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Started child 75961 {{(pid=75804) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Full set of CONF: {{(pid=75804) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] ******************************************************************************** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Configuration options gathered from: {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] ================================================================================ {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] allow_availability_zone_fallback = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] allow_compression_on_image_upload = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] allowed_direct_url_schemes = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] api_rate_limit = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] auth_strategy = keystone {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] az_cache_duration = 3600 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_availability_zone = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_host = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75961]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_stats_polling_interval = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backup_api_class = cinder.backup.api.API {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backup_name_template = backup-%s {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backup_use_same_host = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backup_use_temp_snapshot = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] chap_password = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] chap_username = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_internal_tenant_project_id = 5e8589cc0ec144209077137179977ee2 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_internal_tenant_user_id = 1e1a0ee74bad497dbd527cad328b3e68 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cloned_volume_same_az = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cluster = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] compression_format = gzip {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] compute_api_class = cinder.compute.nova.API {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] config_dir = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] config_source = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] control_exchange = openstack {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] debug = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] default_availability_zone = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] default_group_type = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] default_volume_type = lvmdriver-1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] disk_geometry = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] driver_client_cert = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] driver_client_cert_key = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] driver_data_namespace = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] driver_ssl_cert_path = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] driver_ssl_cert_verify = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] driver_use_ssl = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] enable_force_upload = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] enable_new_services = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] enable_unsupported_driver = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] enabled_backends = ['lvmdriver-1'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] enforce_multipath_for_image_xfer = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] filter_function = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_api_insecure = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_api_servers = ['http://192.168.122.15/image'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_api_ssl_compression = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_ca_certificates_file = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_catalog_info = image:glance:publicURL {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_certfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_keyfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_num_retries = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance_request_timeout = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] goodness_function = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] graceful_shutdown_timeout = 5 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] group_api_class = cinder.group.api.API {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] host = devstack {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_compress_on_upload = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:25 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_conversion_address_space_limit = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_conversion_cpu_limit = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_conversion_disable = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_upload_use_cinder_backend = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_upload_use_internal_tenant = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_volume_cache_enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_volume_cache_max_count = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] image_volume_cache_max_size_gb = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] init_host_max_objects_retrieval = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] instance_format = [instance: %(uuid)s] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] iscsi_target_flags = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] iscsi_write_cache = on {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] iser_helper = tgtadm {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] iser_ip_address = 192.168.122.15 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] iser_port = 3260 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_color = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_config_append = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_dir = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_file = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_options = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_rotate_interval = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_rotate_interval_type = days {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] log_rotation_type = none {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] max_age = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] max_logfile_count = 30 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] max_logfile_size_mb = 200 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] max_over_subscription_ratio = 20.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] message_reap_interval = 86400 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] message_ttl = 2592000 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] migration_create_volume_timeout_secs = 300 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] monkey_patch = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] monkey_patch_modules = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] my_ip = 192.168.122.15 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] no_snapshot_gb_quota = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] num_iser_scan_tries = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] num_shell_tries = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] num_volume_device_scan_tries = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] nvmeof_conn_info_version = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] nvmet_ns_id = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] nvmet_port_id = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] osapi_max_limit = 1000 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] osapi_volume_ext_list = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] osapi_volume_listen = 0.0.0.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] osapi_volume_listen_port = 8776 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] osapi_volume_use_ssl = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] osapi_volume_workers = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] per_volume_size_limit = -1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] periodic_fuzzy_delay = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] periodic_interval = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] project_id_regex = [0-9a-f\-]+ {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] public_endpoint = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] publish_errors = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] quota_backup_gigabytes = 1000 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] quota_backups = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] quota_gigabytes = 1000 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] quota_groups = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] quota_snapshots = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] quota_volumes = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] rate_limit_burst = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] rate_limit_except_level = CRITICAL {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] rate_limit_interval = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] reinit_driver_count = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] replication_device = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] report_discard_supported = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] report_interval = 120 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] reservation_clean_interval = 86400 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] reservation_expire = 86400 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] reserved_image_namespaces = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] reserved_percentage = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] rpc_response_timeout = 120 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] run_external_periodic_tasks = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] scst_target_driver = iscsi {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] scst_target_iqn_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_down_time = 720 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] shell_completion = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] snapshot_name_template = snapshot-%s {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] snapshot_same_host = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] split_loggers = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] state_path = /opt/stack/data/cinder {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] storage_availability_zone = nova {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] storage_protocol = iSCSI {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] syslog_log_facility = LOG_USER {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] target_helper = lioadm {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] target_ip_address = 192.168.122.15 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] target_port = 3260 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] target_protocol = iscsi {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] target_secondary_ip_addresses = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] trace_flags = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] transfer_api_class = cinder.transfer.api.API {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] transport_url = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] until_refresh = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] use_chap_auth = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] use_default_quota_class = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] use_journal = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] use_json = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] use_multipath_for_image_xfer = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] use_stderr = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] use_syslog = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] verify_glance_signatures = enabled {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_api_class = cinder.volume.api.API {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_backend_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_clear = zero {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_clear_ionice = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_clear_size = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_copy_bps_limit = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_dd_blocksize = 1M {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_name_template = volume-%s {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75961]: INFO cinder.volume.manager [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_service_inithost_offload = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volume_usage_audit_period = month {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] zoning_mode = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_concurrency.disable_process_locking = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.auth_section = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.auth_type = password {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.auth_version = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.cache = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.certfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.include_service_catalog = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.insecure = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.interface = public {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.keyfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_password = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcache_username = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.region_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.service_token_roles_required = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.service_type = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.15/identity {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.backend = dogpile.cache.null {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.backend_argument = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.backend_expiration_time = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.config_prefix = cache.oslo {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.debug_cache_backend = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.enable_retry_client = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.enable_socket_keepalive = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.expiration_time = 600 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.hashclient_retry_attempts = 2 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.memcache_dead_retry = 300 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.memcache_pool_maxsize = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.memcache_sasl_enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.password = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.proxies = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.redis_db = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.redis_server = localhost:6379 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.retry_attempts = 2 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.retry_delay = 0.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.socket_keepalive_count = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.socket_keepalive_idle = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.socket_keepalive_interval = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.socket_timeout = 1.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.tls_allowed_ciphers = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.tls_cafile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.tls_certfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.tls_enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.tls_keyfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cache.username = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] coordination.backend_url = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.asyncio_connection = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.asyncio_slave_connection = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.backend = sqlalchemy {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.connection = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.connection_debug = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.connection_parameters = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.connection_recycle_time = 3600 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.connection_trace = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.db_inc_retry_interval = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.db_max_retries = 20 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.db_max_retry_interval = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.db_retry_interval = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.max_overflow = 50 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.max_pool_size = 5 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.max_retries = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.mysql_wsrep_sync_wait = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.pool_timeout = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.retry_interval = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.slave_connection = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.sqlite_synchronous = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.synchronous_reader = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] database.use_db_reconnect = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_tracing.insecure = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.connection_string = messaging:// {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.es_doc_type = notification {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.es_scroll_size = 10000 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.es_scroll_time = 2m {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.filter_error_trace = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.hmac_keys = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.sentinel_service_name = mymaster {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.socket_timeout = 0.1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.trace_requests = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler.trace_sqlalchemy = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler_jaeger.process_tags = {} {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler_jaeger.service_name_prefix = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] profiler_otlp.service_name_prefix = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.enforce_new_defaults = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.policy_default_rule = default {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.policy_file = policy.yaml {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_policy.remote_timeout = 60.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] privsep_osbrick.group = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] privsep_osbrick.helper_command = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] privsep_osbrick.user = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_sys_admin.group = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_sys_admin.helper_command = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] cinder_sys_admin.user = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.auth_section = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.auth_type = password {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.cafile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.certfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.collect_timing = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.insecure = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.keyfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.send_service_user_token = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.split_loggers = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] service_user.timeout = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.auth_section = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.auth_type = password {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.certfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.collect_timing = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.insecure = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.keyfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.region_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.split_loggers = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] glance.timeout = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.backend_availability_zone = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.chap_password = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.chap_username = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.disk_geometry = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.driver_client_cert = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.driver_client_cert_key = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.driver_data_namespace = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.driver_use_ssl = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.extra_capabilities = {} {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.filter_function = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.goodness_function = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.iscsi_target_flags = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.iscsi_write_cache = on {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.iser_helper = tgtadm {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.iser_ip_address = 192.168.122.15 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.iser_port = 3260 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.lvm_mirrors = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.lvm_share_target = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.lvm_type = auto {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.num_shell_tries = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.replication_device = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.report_discard_supported = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.reserved_percentage = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.target_helper = tgtadm {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.target_ip_address = 192.168.122.15 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.target_port = 3260 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.target_protocol = iscsi {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.trace_flags = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.unique_fqdn_network = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.use_chap_auth = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_backend_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_clear = zero {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_clear_ionice = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_clear_size = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volume_group = cinder-volumes {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_reports.file_event_handler = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_reports.log_dir = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.backend_host = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.chap_password = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.chap_username = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.chiscsi_conf = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.disk_geometry = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.driver_client_cert = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.driver_use_ssl = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.extra_capabilities = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.filter_function = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.goodness_function = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.iser_helper = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.iser_ip_address = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.iser_port = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.lvm_conf_file = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.lvm_mirrors = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.lvm_share_target = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.lvm_type = auto {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.num_shell_tries = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.nvmet_port_id = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.replication_device = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.report_discard_supported = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.reserved_percentage = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.scst_target_driver = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.storage_protocol = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.target_helper = lioadm {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.target_ip_address = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.target_port = 3260 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack sudo[75993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.target_protocol = iscsi {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.trace_flags = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.use_chap_auth = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack sudo[75993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_clear = zero {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_clear_size = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] lvmdriver-1.volumes_dir = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.ssl = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.ssl_version = {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_notifications.driver = [] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_notifications.retry = -1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] key_manager.fixed_key = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.barbican_api_version = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.barbican_endpoint = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.barbican_endpoint_type = public {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.barbican_region_name = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.cafile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.certfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.collect_timing = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.insecure = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.keyfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.number_of_retries = 60 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.retry_delay = 1 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.send_service_user_token = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.split_loggers = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.timeout = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.verify_ssl = True {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican.verify_ssl_path = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.auth_section = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.auth_type = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.cafile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.certfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.collect_timing = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.insecure = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.keyfile = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.split_loggers = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] barbican_service_user.timeout = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.approle_role_id = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.approle_secret_id = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.auth_method = approle {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.auth_path = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.kv_mountpoint = secret {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.kv_path = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.kv_version = 2 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.namespace = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.root_token_id = **** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.ssl_ca_crt_file = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.timeout = 60.0 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.token_file = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.token_role = None {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.use_ssl = False {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:54:26 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] ******************************************************************************** {{(pid=75804) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:54:26 devstack sudo[75993]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:26 devstack sudo[76106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:26 devstack sudo[76106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:26 devstack sudo[76106]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.322s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:54:26 devstack cinder-volume[75961]: INFO cinder.brick.local_dev.lvm [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:26 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:26 devstack sudo[76213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:26 devstack sudo[76213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:27 devstack sudo[76213]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:27 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:27 devstack cinder-volume[75961]: DEBUG cinder.brick.local_dev.lvm [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75961) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 01:54:27 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:27 devstack sudo[76345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:27 devstack sudo[76345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:27 devstack sudo[76345]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:27 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.538s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:27 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:27 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:27 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:27 devstack sudo[76530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:27 devstack sudo[76530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:28 devstack sudo[76530]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:28 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.348s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:28 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:28 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:28 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:28 devstack sudo[76609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 01:54:28 devstack sudo[76609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:28 devstack sudo[76609]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:28 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.328s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:28 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:28 devstack sudo[76693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:28 devstack sudo[76693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:28 devstack sudo[76693]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:28 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:28 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:28 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:28 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:29 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:29 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:29 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:29 devstack sudo[76717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:29 devstack sudo[76717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:29 devstack sudo[76717]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:29 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:29 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:29 devstack sudo[76789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:29 devstack sudo[76789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:29 devstack sudo[76789]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:29 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:29 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:29 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:29 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:29 devstack sudo[76799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:29 devstack sudo[76799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:30 devstack sudo[76799]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:30 devstack cinder-volume[75961]: INFO cinder.volume.drivers.lvm [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:30 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:30 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:30 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG cinder.volume.drivers.lvm [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Updating volume stats {{(pid=75961) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:30 devstack sudo[76806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:30 devstack sudo[76806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:30 devstack sudo[76806]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:30 devstack sudo[76809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:30 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:30 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:30 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:30 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:30 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:31 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:31 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:31 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:31 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:31 devstack cinder-volume[75961]: INFO cinder.volume.driver [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG cinder.volume.driver [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75961) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG oslo_db.sqlalchemy.engines [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75961) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG dbcounter [-] [75961] Writer thread running {{(pid=75961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG cinder.db.api [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Building query based on filter {{(pid=75961) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG cinder.image.image_utils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75961) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:54:31 devstack cinder-volume[75961]: INFO cinder.keymgr.migration [None req-9e50351e-b680-4737-8cdf-cbdd72ebd309 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG cinder.volume.drivers.lvm [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Updating volume stats {{(pid=75961) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:31 devstack sudo[76820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:31 devstack sudo[76820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:31 devstack sudo[76820]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:31 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:31 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:31 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:32 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:32 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:32 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:32 devstack sudo[76827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:32 devstack sudo[76827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:32 devstack sudo[76827]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:32 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:32 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:32 devstack sudo[76830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:32 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:32 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:32 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.343s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:32 devstack cinder-volume[75961]: DEBUG cinder.manager [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Notifying Schedulers of capabilities ... {{(pid=75961) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:54:32 devstack cinder-volume[75961]: INFO cinder.volume.manager [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Driver initialization completed successfully. Sep 01 01:54:32 devstack cinder-volume[75961]: INFO cinder.manager [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Initiating service 2 cleanup Sep 01 01:54:32 devstack cinder-volume[75961]: INFO cinder.manager [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Service 2 cleanup completed. Sep 01 01:54:32 devstack cinder-volume[75961]: DEBUG cinder.service [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Creating RPC server for service cinder-volume {{(pid=75961) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:54:32 devstack cinder-volume[75961]: DEBUG cinder.service [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75961) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:54:33 devstack cinder-volume[75961]: INFO cinder.volume.manager [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 01:54:33 devstack cinder-volume[75961]: DEBUG cinder.volume.drivers.lvm [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Updating volume stats {{(pid=75961) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:54:33 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:33 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:54:33 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:33 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:33 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:33 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:33 devstack sudo[76842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:33 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:33 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:33 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:33 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:33 devstack sudo[76845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:54:33 devstack sudo[76845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:34 devstack sudo[76845]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:34 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:34 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:54:34 devstack sudo[76848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:54:34 devstack sudo[76848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:54:34 devstack sudo[76848]: pam_unix(sudo:session): session closed for user root Sep 01 01:54:34 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:54:34 devstack cinder-volume[75961]: INFO cinder.volume.manager [None req-b2c084d3-84aa-4fa3-9496-8f8bdb797d9c None None] Driver post RPC initialization completed successfully. Sep 01 01:54:35 devstack cinder-volume[75804]: DEBUG dbcounter [-] [75804] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75804) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:54:44 devstack cinder-volume[75961]: DEBUG dbcounter [-] [75961] Writing DB stats cinder:SELECT=3 {{(pid=75961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:54:44 devstack cinder-volume[75961]: DEBUG dbcounter [-] [75961] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:55:21 devstack cinder-volume[75961]: DEBUG oslo_service.periodic_task [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running periodic task VolumeManager._thread_info {{(pid=75961) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:55:21 devstack cinder-volume[75961]: DEBUG cinder.volume.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] thread count: 6 {{(pid=75961) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:55:21 devstack cinder-volume[75961]: DEBUG cinder.volume.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] thread info: [<_MainThread(MainThread, started 123953107230848)>, , , , , ] {{(pid=75961) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:56:21 devstack cinder-volume[75961]: DEBUG oslo_service.periodic_task [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75961) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:56:21 devstack cinder-volume[75961]: DEBUG cinder.volume.drivers.lvm [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Updating volume stats {{(pid=75961) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:56:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:21 devstack sudo[82459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:56:21 devstack sudo[82459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:21 devstack sudo[82459]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:21 devstack sudo[82462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:56:21 devstack sudo[82462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:21 devstack sudo[82462]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:21 devstack sudo[82465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:56:21 devstack sudo[82465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:22 devstack sudo[82465]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:56:22 devstack sudo[82468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:56:22 devstack sudo[82468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:56:22 devstack sudo[82468]: pam_unix(sudo:session): session closed for user root Sep 01 01:56:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:56:22 devstack cinder-volume[75961]: DEBUG cinder.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Notifying Schedulers of capabilities ... {{(pid=75961) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:56:22 devstack cinder-volume[75961]: DEBUG oslo_service.periodic_task [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running periodic task VolumeManager._thread_info {{(pid=75961) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:56:22 devstack cinder-volume[75961]: DEBUG cinder.volume.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] thread count: 6 {{(pid=75961) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:56:22 devstack cinder-volume[75961]: DEBUG cinder.volume.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] thread info: [<_MainThread(MainThread, started 123953107230848)>, , , , , ] {{(pid=75961) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:56:44 devstack cinder-volume[75961]: DEBUG dbcounter [-] [75961] Writing DB stats cinder:SELECT=1 {{(pid=75961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:44 devstack cinder-volume[75961]: DEBUG dbcounter [-] [75961] Writing DB stats cinder:UPDATE=1 {{(pid=75961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:57:21 devstack cinder-volume[75961]: DEBUG oslo_service.periodic_task [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75961) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:57:21 devstack cinder-volume[75961]: DEBUG cinder.volume.drivers.lvm [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Updating volume stats {{(pid=75961) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:57:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:21 devstack sudo[83982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:57:21 devstack sudo[83982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:21 devstack sudo[83982]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:21 devstack sudo[84021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:57:21 devstack sudo[84021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:21 devstack sudo[84021]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:21 devstack sudo[84024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:57:21 devstack sudo[84024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:22 devstack sudo[84024]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:22 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:57:22 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:22 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:22 devstack cinder-volume[75961]: DEBUG cinder.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Notifying Schedulers of capabilities ... {{(pid=75961) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:21 devstack cinder-volume[75961]: DEBUG oslo_service.periodic_task [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75961) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:21 devstack cinder-volume[75961]: DEBUG cinder.volume.drivers.lvm [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Updating volume stats {{(pid=75961) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:58:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:21 devstack sudo[85398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:58:21 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:21 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:21 devstack sudo[85401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:58:21 devstack sudo[85401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:21 devstack sudo[85401]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:21 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:21 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:58:21 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:22 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:22 devstack sudo[85425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:58:22 devstack sudo[85425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:22 devstack sudo[85425]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:22 devstack cinder-volume[75961]: DEBUG oslo_concurrency.processutils [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:22 devstack cinder-volume[75961]: DEBUG cinder.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Notifying Schedulers of capabilities ... {{(pid=75961) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:22 devstack cinder-volume[75961]: DEBUG oslo_service.periodic_task [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] Running periodic task VolumeManager._thread_info {{(pid=75961) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:22 devstack cinder-volume[75961]: DEBUG cinder.volume.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] thread count: 6 {{(pid=75961) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:58:22 devstack cinder-volume[75961]: DEBUG cinder.volume.manager [None req-745aa4b0-bf7a-486c-a11f-c9504d29e9ea None None] thread info: [<_MainThread(MainThread, started 123953107230848)>, , , , , ] {{(pid=75961) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:58:44 devstack cinder-volume[75961]: DEBUG dbcounter [-] [75961] Writing DB stats cinder:SELECT=1 {{(pid=75961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:44 devstack cinder-volume[75961]: DEBUG dbcounter [-] [75961] Writing DB stats cinder:UPDATE=1 {{(pid=75961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:13 devstack cinder-volume[75804]: INFO oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Caught SIGTERM, stopping children Sep 01 01:59:13 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Acquiring lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:59:13 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Acquired lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:59:13 devstack cinder-volume[75804]: DEBUG oslo_concurrency.lockutils [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Releasing lock "singleton_lock" {{(pid=75804) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:59:13 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Stop services. {{(pid=75804) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:59:14 devstack cinder-volume[75804]: DEBUG oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Killing children. {{(pid=75804) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:59:14 devstack cinder-volume[75804]: INFO oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Waiting on 1 children to exit Sep 01 01:59:18 devstack cinder-volume[75961]: DEBUG oslo_concurrency.lockutils [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Acquiring lock "singleton_lock" {{(pid=75961) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:59:18 devstack cinder-volume[75961]: DEBUG oslo_concurrency.lockutils [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Acquired lock "singleton_lock" {{(pid=75961) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:59:18 devstack cinder-volume[75961]: DEBUG oslo_concurrency.lockutils [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Releasing lock "singleton_lock" {{(pid=75961) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:59:18 devstack cinder-volume[75961]: WARNING amqp [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:59:18 devstack cinder-volume[75961]: WARNING amqp [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:59:18 devstack cinder-volume[75804]: INFO oslo_service.backend._eventlet.service [None req-7ee49f76-740b-4805-85bb-4b8068d6383a None None] Child 75961 exited with status 0 Sep 01 01:59:18 devstack cinder-volume[86563]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:59:18 devstack cinder-volume[86563]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:59:18 devstack cinder-volume[86563]: we strongly recommend against using it for new projects. Sep 01 01:59:18 devstack cinder-volume[86563]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:59:18 devstack cinder-volume[86563]: framework. For more detail see Sep 01 01:59:18 devstack cinder-volume[86563]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:59:18 devstack cinder-volume[86563]: import eventlet # noqa Sep 01 01:59:20 devstack cinder-volume[86563]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86563) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:59:20 devstack cinder-volume[86563]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86563) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:59:20 devstack cinder-volume[86563]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86563) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:59:21 devstack cinder-volume[86563]: INFO dbcounter [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Registered counter for database cinder Sep 01 01:59:21 devstack cinder-volume[86563]: DEBUG oslo_db.sqlalchemy.engines [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG dbcounter [-] [86563] Writer thread running {{(pid=86563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:59:22 devstack cinder-volume[86563]: INFO cinder.rpc [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:59:22 devstack cinder-volume[86563]: INFO cinder.rpc [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_db.sqlalchemy.engines [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:59:22 devstack cinder-volume[86563]: INFO cinder.volume.manager [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Determined volume DB was empty at startup. Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG cinder.volume.manager [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86563) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:59:22 devstack cinder-volume[86563]: INFO cinder.volume.manager [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:59:22 devstack cinder-volume[86563]: WARNING stevedore.named [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:59:22 devstack cinder-volume[86563]: WARNING castellan.key_manager [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:59:22 devstack cinder-volume[86563]: WARNING cinder.keymgr.conf_key_mgr [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:59:22 devstack cinder-volume[86563]: INFO cinder.volume.manager [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_db.sqlalchemy.engines [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:59:22 devstack cinder-volume[86563]: INFO oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Starting 1 workers Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Started child 86846 {{(pid=86563) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Full set of CONF: {{(pid=86563) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] ******************************************************************************** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Configuration options gathered from: {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] ================================================================================ {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] allow_availability_zone_fallback = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] allow_compression_on_image_upload = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] allowed_direct_url_schemes = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] api_rate_limit = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] auth_strategy = keystone {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_availability_zone = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_host = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_stats_polling_interval = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backup_api_class = cinder.backup.api.API {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86846]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backup_name_template = backup-%s {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backup_use_same_host = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backup_use_temp_snapshot = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] chap_password = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] chap_username = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_internal_tenant_project_id = 5e8589cc0ec144209077137179977ee2 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_internal_tenant_user_id = 1e1a0ee74bad497dbd527cad328b3e68 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cluster = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] compression_format = gzip {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] compute_api_class = cinder.compute.nova.API {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] config_dir = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] config_source = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] control_exchange = openstack {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] debug = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] default_availability_zone = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] default_group_type = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] default_volume_type = QuobyteHD {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] disk_geometry = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] driver_client_cert = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] driver_client_cert_key = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] driver_data_namespace = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] driver_ssl_cert_path = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] driver_ssl_cert_verify = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] driver_use_ssl = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] enable_new_services = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] enable_unsupported_driver = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] enabled_backends = ['QuobyteHD'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] enforce_multipath_for_image_xfer = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] filter_function = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_api_insecure = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_api_servers = ['http://192.168.122.15/image'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_api_ssl_compression = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_ca_certificates_file = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_catalog_info = image:glance:publicURL {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_certfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_keyfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_num_retries = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance_request_timeout = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] goodness_function = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] graceful_shutdown_timeout = 5 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] group_api_class = cinder.group.api.API {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] host = devstack {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_compress_on_upload = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_conversion_address_space_limit = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_conversion_cpu_limit = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_conversion_disable = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_upload_use_cinder_backend = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_upload_use_internal_tenant = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_volume_cache_enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_volume_cache_max_count = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] image_volume_cache_max_size_gb = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] init_host_max_objects_retrieval = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] instance_format = [instance: %(uuid)s] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] iscsi_target_flags = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] iscsi_write_cache = on {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] iser_helper = tgtadm {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] iser_ip_address = 192.168.122.15 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] iser_port = 3260 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_color = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_config_append = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_dir = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_file = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_options = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_rotate_interval = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_rotate_interval_type = days {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] log_rotation_type = none {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] max_age = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] max_logfile_count = 30 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] max_logfile_size_mb = 200 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] max_over_subscription_ratio = 20.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] message_reap_interval = 86400 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] message_ttl = 2592000 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] migration_create_volume_timeout_secs = 300 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] monkey_patch = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] monkey_patch_modules = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] my_ip = 192.168.122.15 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] no_snapshot_gb_quota = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] num_iser_scan_tries = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] num_shell_tries = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] num_volume_device_scan_tries = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] nvmeof_conn_info_version = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] nvmet_ns_id = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] nvmet_port_id = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] osapi_max_limit = 1000 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] osapi_volume_ext_list = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] osapi_volume_listen_port = 8776 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] osapi_volume_use_ssl = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] osapi_volume_workers = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] per_volume_size_limit = -1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] periodic_fuzzy_delay = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] periodic_interval = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] public_endpoint = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] publish_errors = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] quota_backup_gigabytes = 1000 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] quota_backups = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] quota_gigabytes = 1000 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] quota_groups = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] quota_snapshots = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] quota_volumes = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] rate_limit_burst = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] rate_limit_except_level = CRITICAL {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] rate_limit_interval = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] reinit_driver_count = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] replication_device = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] report_discard_supported = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] report_interval = 120 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] reservation_clean_interval = 86400 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] reservation_expire = 86400 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] reserved_image_namespaces = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] reserved_percentage = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] rpc_response_timeout = 120 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] run_external_periodic_tasks = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] scst_target_driver = iscsi {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] scst_target_iqn_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_down_time = 720 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] shell_completion = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] snapshot_name_template = snapshot-%s {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] split_loggers = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] state_path = /opt/stack/data/cinder {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] storage_availability_zone = nova {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] storage_protocol = iSCSI {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] syslog_log_facility = LOG_USER {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] target_helper = lioadm {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.remotefs [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86846) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] target_ip_address = 192.168.122.15 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] target_port = 3260 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] target_protocol = iscsi {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] target_secondary_ip_addresses = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] trace_flags = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] transport_url = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] until_refresh = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] use_chap_auth = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] use_default_quota_class = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] use_journal = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] use_json = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] use_multipath_for_image_xfer = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] use_stderr = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] use_syslog = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] verify_glance_signatures = enabled {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_api_class = cinder.volume.api.API {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_backend_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_clear = zero {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_clear_ionice = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_clear_size = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_copy_bps_limit = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_dd_blocksize = 1M {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_name_template = volume-%s {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_service_inithost_offload = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volume_usage_audit_period = month {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] zoning_mode = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_concurrency.disable_process_locking = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.auth_section = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.auth_type = password {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.auth_version = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.cache = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.certfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.include_service_catalog = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.insecure = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.interface = public {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.keyfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_password = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcache_username = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.region_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.service_type = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.15/identity {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.backend = dogpile.cache.null {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.backend_argument = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.backend_expiration_time = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.config_prefix = cache.oslo {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.debug_cache_backend = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.enable_retry_client = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.enable_socket_keepalive = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.expiration_time = 600 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.hashclient_retry_attempts = 2 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.memcache_dead_retry = 300 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.memcache_pool_maxsize = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.memcache_sasl_enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.password = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.proxies = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.redis_db = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.redis_server = localhost:6379 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.retry_attempts = 2 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.retry_delay = 0.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.socket_keepalive_count = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.socket_keepalive_idle = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.socket_keepalive_interval = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.socket_timeout = 1.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.tls_allowed_ciphers = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.tls_cafile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.tls_certfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.tls_enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.tls_keyfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cache.username = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] coordination.backend_url = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.asyncio_connection = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.asyncio_slave_connection = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.backend = sqlalchemy {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.connection = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.connection_debug = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.connection_parameters = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.connection_recycle_time = 3600 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.connection_trace = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.db_inc_retry_interval = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.db_max_retries = 20 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.db_max_retry_interval = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.db_retry_interval = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.max_overflow = 50 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.max_pool_size = 5 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.max_retries = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.mysql_wsrep_sync_wait = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.pool_timeout = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.retry_interval = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.slave_connection = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.sqlite_synchronous = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.synchronous_reader = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] database.use_db_reconnect = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_tracing.insecure = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.connection_string = messaging:// {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.es_doc_type = notification {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.es_scroll_size = 10000 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.es_scroll_time = 2m {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.filter_error_trace = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.hmac_keys = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.sentinel_service_name = mymaster {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.socket_timeout = 0.1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.trace_requests = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler.trace_sqlalchemy = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler_jaeger.process_tags = {} {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler_jaeger.service_name_prefix = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] profiler_otlp.service_name_prefix = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.enforce_new_defaults = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.policy_default_rule = default {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.policy_file = policy.yaml {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] privsep_osbrick.group = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] privsep_osbrick.helper_command = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] privsep_osbrick.user = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_sys_admin.group = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_sys_admin.helper_command = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] cinder_sys_admin.user = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.auth_section = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.auth_type = password {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.cafile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.certfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.collect_timing = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.insecure = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.keyfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.send_service_user_token = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.split_loggers = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] service_user.timeout = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.auth_section = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.auth_type = password {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.certfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.collect_timing = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.insecure = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.keyfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.region_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.split_loggers = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] glance.timeout = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.backend_availability_zone = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.chap_password = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.chap_username = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.disk_geometry = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.driver_client_cert = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.driver_client_cert_key = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.driver_data_namespace = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.driver_use_ssl = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.extra_capabilities = {} {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.filter_function = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.goodness_function = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.iscsi_target_flags = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.iscsi_write_cache = on {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.iser_helper = tgtadm {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.iser_ip_address = 192.168.122.15 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.iser_port = 3260 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_host = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_login = admin {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_mount_options = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_password = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_private_key = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_share_path = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.num_shell_tries = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.quobyte_volume_url = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.replication_device = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.report_discard_supported = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.reserved_percentage = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.target_helper = tgtadm {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.target_ip_address = 192.168.122.15 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.target_port = 3260 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.target_protocol = iscsi {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.trace_flags = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.unique_fqdn_network = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.use_chap_auth = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volume_backend_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volume_clear = zero {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volume_clear_ionice = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volume_clear_size = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86846) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_reports.file_event_handler = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_reports.log_dir = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.backend_availability_zone = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.backend_host = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.chap_password = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.chap_username = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.chiscsi_conf = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86846]: WARNING cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.disk_geometry = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.driver_client_cert = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.driver_data_namespace = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Running cmd (subprocess): mount.quobyte {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.driver_use_ssl = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.extra_capabilities = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.filter_function = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.goodness_function = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.iser_helper = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.iser_ip_address = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.iser_port = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.iser_target_prefix = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_host = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_login = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_mount_options = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_password = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_private_key = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_share_path = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_ssh_port = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.num_shell_tries = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.nvmet_port_id = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.replication_device = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.report_discard_supported = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.reserved_percentage = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.scst_target_driver = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.storage_protocol = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.target_helper = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.target_ip_address = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.target_port = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.target_prefix = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.target_protocol = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.trace_flags = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.use_chap_auth = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volume_clear = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volume_clear_size = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] QuobyteHD.volumes_dir = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.ssl = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_notifications.driver = [] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_notifications.retry = -1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] key_manager.fixed_key = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.barbican_api_version = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.barbican_endpoint = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.barbican_endpoint_type = public {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.barbican_region_name = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.cafile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.certfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.collect_timing = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.insecure = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.keyfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.number_of_retries = 60 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.retry_delay = 1 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.send_service_user_token = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.split_loggers = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.timeout = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.verify_ssl = True {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican.verify_ssl_path = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.auth_section = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.auth_type = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.cafile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.certfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.collect_timing = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.insecure = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.keyfile = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.split_loggers = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] barbican_service_user.timeout = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.approle_role_id = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.approle_secret_id = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.auth_method = approle {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.auth_path = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.kv_mountpoint = secret {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.kv_path = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.kv_version = 2 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.namespace = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.root_token_id = **** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.ssl_ca_crt_file = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.timeout = 60.0 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.token_file = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.token_role = None {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.use_ssl = False {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:22 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] ******************************************************************************** {{(pid=86563) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:59:22 devstack quobyte-client[86847]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:59:22 devstack quobyte-client[86847]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:59:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:22 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:22 devstack cinder-volume[86846]: INFO cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 ... Sep 01 01:59:22 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 -c /etc/quobyte/client-cinder.cfg {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:23 devstack sudo[86850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 -c /etc/quobyte/client-cinder.cfg Sep 01 01:59:23 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:23 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.476s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:23 devstack cinder-volume[86846]: INFO cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 succeeded Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.499s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:23 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 01:59:23 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:23 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.277s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:23 devstack cinder-volume[86846]: INFO cinder.volume.driver [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG cinder.volume.driver [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0264511108398, 'free_capacity_gb': 1774.0264511108398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86846) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_db.sqlalchemy.engines [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86846) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writer thread running {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG cinder.db.api [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Building query based on filter {{(pid=86846) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG cinder.image.image_utils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86846) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:59:23 devstack cinder-volume[86846]: INFO cinder.keymgr.migration [None req-fceacb4f-46d8-4e1a-bc07-ab777f1e0922 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:23 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:23 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 01:59:23 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:24 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.247s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Driver initialization completed successfully. Sep 01 01:59:24 devstack cinder-volume[86846]: INFO cinder.manager [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Initiating service 3 cleanup Sep 01 01:59:24 devstack cinder-volume[86846]: INFO cinder.manager [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Service 3 cleanup completed. Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG cinder.service [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Creating RPC server for service cinder-volume {{(pid=86846) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG cinder.service [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86846) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:59:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:24 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 01:59:24 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:24 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:24 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.302s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:24 devstack cinder-volume[86846]: INFO cinder.volume.manager [None req-b7cf69ae-1df2-4d74-a0a7-a297abd57b2d None None] Driver post RPC initialization completed successfully. Sep 01 01:59:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddeada0e-cc7f-48aa-b1f4-9e51cad76384 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddeada0e-cc7f-48aa-b1f4-9e51cad76384 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ddeada0e-cc7f-48aa-b1f4-9e51cad76384 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=86846) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:29 devstack cinder-volume[86846]: DEBUG cinder.volume.drivers.quobyte [None req-ddeada0e-cc7f-48aa-b1f4-9e51cad76384 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=86846) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-ddeada0e-cc7f-48aa-b1f4-9e51cad76384 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86846) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ddeada0e-cc7f-48aa-b1f4-9e51cad76384 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:29 devstack sudo[87084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 01:59:29 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:29 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:29 devstack cinder-volume[86846]: DEBUG oslo_concurrency.processutils [None req-ddeada0e-cc7f-48aa-b1f4-9e51cad76384 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.245s {{(pid=86846) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:29 devstack cinder-volume[86846]: DEBUG cinder.manager [None req-ddeada0e-cc7f-48aa-b1f4-9e51cad76384 None None] Notifying Schedulers of capabilities ... {{(pid=86846) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:32 devstack cinder-volume[86563]: DEBUG dbcounter [-] [86563] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86563) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:33 devstack cinder-volume[86563]: INFO oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Caught SIGTERM, stopping children Sep 01 01:59:33 devstack cinder-volume[86563]: DEBUG oslo_concurrency.lockutils [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Acquiring lock "singleton_lock" {{(pid=86563) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:59:33 devstack cinder-volume[86563]: DEBUG oslo_concurrency.lockutils [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Acquired lock "singleton_lock" {{(pid=86563) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:59:33 devstack cinder-volume[86563]: DEBUG oslo_concurrency.lockutils [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Releasing lock "singleton_lock" {{(pid=86563) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:59:33 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Stop services. {{(pid=86563) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 01:59:33 devstack cinder-volume[86563]: DEBUG oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Killing children. {{(pid=86563) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 01:59:33 devstack cinder-volume[86563]: INFO oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Waiting on 1 children to exit Sep 01 01:59:34 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:34 devstack cinder-volume[86846]: DEBUG dbcounter [-] [86846] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=86846) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Acquiring lock "singleton_lock" {{(pid=86846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:59:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Acquired lock "singleton_lock" {{(pid=86846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:59:37 devstack cinder-volume[86846]: DEBUG oslo_concurrency.lockutils [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Releasing lock "singleton_lock" {{(pid=86846) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:59:37 devstack cinder-volume[86846]: WARNING amqp [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:59:37 devstack cinder-volume[86846]: WARNING amqp [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 01:59:37 devstack cinder-volume[86563]: INFO oslo_service.backend._eventlet.service [None req-309cb9f9-cccc-494a-8c83-77e0ad365c8f None None] Child 86846 exited with status 0 Sep 01 01:59:38 devstack cinder-volume[87174]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:59:38 devstack cinder-volume[87174]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:59:38 devstack cinder-volume[87174]: we strongly recommend against using it for new projects. Sep 01 01:59:38 devstack cinder-volume[87174]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:59:38 devstack cinder-volume[87174]: framework. For more detail see Sep 01 01:59:38 devstack cinder-volume[87174]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:59:38 devstack cinder-volume[87174]: import eventlet # noqa Sep 01 01:59:41 devstack cinder-volume[87174]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:59:41 devstack cinder-volume[87174]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:59:41 devstack cinder-volume[87174]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:59:42 devstack cinder-volume[87174]: INFO dbcounter [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Registered counter for database cinder Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_db.sqlalchemy.engines [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG dbcounter [-] [87174] Writer thread running {{(pid=87174) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:59:42 devstack cinder-volume[87174]: INFO cinder.rpc [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:59:42 devstack cinder-volume[87174]: INFO cinder.rpc [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_db.sqlalchemy.engines [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:59:42 devstack cinder-volume[87174]: INFO cinder.volume.manager [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Determined volume DB was empty at startup. Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG cinder.volume.manager [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87174) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:59:42 devstack cinder-volume[87174]: WARNING stevedore.named [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:59:42 devstack cinder-volume[87174]: WARNING castellan.key_manager [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:59:42 devstack cinder-volume[87174]: WARNING cinder.keymgr.conf_key_mgr [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:59:42 devstack cinder-volume[87174]: INFO cinder.volume.manager [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_db.sqlalchemy.engines [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:59:42 devstack cinder-volume[87174]: INFO oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Starting 1 workers Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Started child 87425 {{(pid=87174) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Full set of CONF: {{(pid=87174) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] ******************************************************************************** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] Configuration options gathered from: {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] ================================================================================ {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] allow_availability_zone_fallback = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] allow_compression_on_image_upload = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] allowed_direct_url_schemes = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] api_rate_limit = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] auth_strategy = keystone {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_availability_zone = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_host = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_stats_polling_interval = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backup_api_class = cinder.backup.api.API {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backup_name_template = backup-%s {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backup_use_same_host = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backup_use_temp_snapshot = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] chap_password = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87425]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] chap_username = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_internal_tenant_project_id = 5e8589cc0ec144209077137179977ee2 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_internal_tenant_user_id = 1e1a0ee74bad497dbd527cad328b3e68 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cluster = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] compression_format = gzip {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] compute_api_class = cinder.compute.nova.API {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] config_dir = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] config_source = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] control_exchange = openstack {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] debug = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] default_availability_zone = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] default_group_type = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] default_volume_type = QuobyteHD {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] disk_geometry = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] driver_client_cert = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] driver_client_cert_key = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] driver_data_namespace = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] driver_ssl_cert_path = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] driver_ssl_cert_verify = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] driver_use_ssl = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] enable_new_services = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] enable_unsupported_driver = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] enabled_backends = ['QuobyteHD'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] enforce_multipath_for_image_xfer = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] filter_function = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_api_insecure = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_api_servers = ['http://192.168.122.15/image'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_api_ssl_compression = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_ca_certificates_file = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_catalog_info = image:glance:publicURL {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_certfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_keyfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_num_retries = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance_request_timeout = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] goodness_function = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] graceful_shutdown_timeout = 5 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] group_api_class = cinder.group.api.API {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] host = devstack {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_compress_on_upload = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_conversion_address_space_limit = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_conversion_cpu_limit = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_conversion_disable = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_upload_use_cinder_backend = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_upload_use_internal_tenant = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_volume_cache_enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_volume_cache_max_count = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] image_volume_cache_max_size_gb = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] init_host_max_objects_retrieval = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] instance_format = [instance: %(uuid)s] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] iscsi_target_flags = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] iscsi_write_cache = on {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] iser_helper = tgtadm {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] iser_ip_address = 192.168.122.15 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] iser_port = 3260 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_color = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_config_append = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_dir = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_file = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_options = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_rotate_interval = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_rotate_interval_type = days {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] log_rotation_type = none {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] max_age = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] max_logfile_count = 30 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] max_logfile_size_mb = 200 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] max_over_subscription_ratio = 20.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] message_reap_interval = 86400 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] message_ttl = 2592000 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] migration_create_volume_timeout_secs = 300 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] monkey_patch = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] monkey_patch_modules = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] my_ip = 192.168.122.15 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] no_snapshot_gb_quota = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] num_iser_scan_tries = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] num_shell_tries = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] num_volume_device_scan_tries = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] nvmeof_conn_info_version = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] nvmet_ns_id = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] nvmet_port_id = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] osapi_max_limit = 1000 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] osapi_volume_ext_list = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] osapi_volume_listen_port = 8776 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] osapi_volume_use_ssl = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] osapi_volume_workers = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] per_volume_size_limit = -1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] periodic_fuzzy_delay = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] periodic_interval = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] public_endpoint = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] publish_errors = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] quota_backup_gigabytes = 1000 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] quota_backups = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] quota_gigabytes = 1000 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] quota_groups = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] quota_snapshots = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] quota_volumes = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] rate_limit_burst = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] rate_limit_except_level = CRITICAL {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] rate_limit_interval = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] reinit_driver_count = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] replication_device = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] report_discard_supported = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:42 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] report_interval = 120 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] reservation_clean_interval = 86400 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] reservation_expire = 86400 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] reserved_image_namespaces = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] reserved_percentage = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] rpc_response_timeout = 120 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] run_external_periodic_tasks = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] scst_target_driver = iscsi {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] scst_target_iqn_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_down_time = 720 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] shell_completion = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] snapshot_name_template = snapshot-%s {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] split_loggers = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] state_path = /opt/stack/data/cinder {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] storage_availability_zone = nova {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] storage_protocol = iSCSI {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] syslog_log_facility = LOG_USER {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] target_helper = lioadm {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] target_ip_address = 192.168.122.15 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] target_port = 3260 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] target_protocol = iscsi {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] target_secondary_ip_addresses = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] trace_flags = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] transport_url = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] until_refresh = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] use_chap_auth = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] use_default_quota_class = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] use_journal = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] use_json = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] use_multipath_for_image_xfer = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] use_stderr = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] use_syslog = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] verify_glance_signatures = enabled {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_api_class = cinder.volume.api.API {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_backend_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_clear = zero {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_clear_ionice = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_clear_size = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_copy_bps_limit = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_dd_blocksize = 1M {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_name_template = volume-%s {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_service_inithost_offload = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volume_usage_audit_period = month {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] zoning_mode = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_concurrency.disable_process_locking = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.auth_section = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.auth_type = password {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.auth_version = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.cache = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.certfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.include_service_catalog = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.insecure = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.interface = public {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.keyfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_password = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87425) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcache_username = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.region_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.service_type = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.15/identity {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.backend = dogpile.cache.null {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.backend_argument = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.backend_expiration_time = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.config_prefix = cache.oslo {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.debug_cache_backend = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.enable_retry_client = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.enable_socket_keepalive = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.expiration_time = 600 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.hashclient_retry_attempts = 2 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.memcache_dead_retry = 300 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.memcache_pool_maxsize = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.memcache_sasl_enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.password = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.proxies = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.redis_db = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.redis_server = localhost:6379 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.retry_attempts = 2 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.retry_delay = 0.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.socket_keepalive_count = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.socket_keepalive_idle = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.socket_keepalive_interval = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.socket_timeout = 1.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.tls_allowed_ciphers = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.tls_cafile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.tls_certfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.tls_enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.tls_keyfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cache.username = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] coordination.backend_url = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.asyncio_connection = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.asyncio_slave_connection = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.backend = sqlalchemy {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.connection = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.connection_debug = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.connection_parameters = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.connection_recycle_time = 3600 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.connection_trace = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.db_inc_retry_interval = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.db_max_retries = 20 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.db_max_retry_interval = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.db_retry_interval = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.max_overflow = 50 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.max_pool_size = 5 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.max_retries = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.mysql_wsrep_sync_wait = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.pool_timeout = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.retry_interval = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.slave_connection = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.sqlite_synchronous = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.synchronous_reader = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] database.use_db_reconnect = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_tracing.insecure = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.connection_string = messaging:// {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.es_doc_type = notification {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.es_scroll_size = 10000 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.es_scroll_time = 2m {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.filter_error_trace = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.hmac_keys = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.sentinel_service_name = mymaster {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.socket_timeout = 0.1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.trace_requests = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler.trace_sqlalchemy = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler_jaeger.process_tags = {} {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler_jaeger.service_name_prefix = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] profiler_otlp.service_name_prefix = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.enforce_new_defaults = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.policy_default_rule = default {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.policy_file = policy.yaml {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] privsep_osbrick.group = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] privsep_osbrick.helper_command = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] privsep_osbrick.user = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_sys_admin.group = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_sys_admin.helper_command = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] cinder_sys_admin.user = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.auth_section = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.auth_type = password {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.cafile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.certfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.collect_timing = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.insecure = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.keyfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.send_service_user_token = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.split_loggers = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] service_user.timeout = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.auth_section = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.auth_type = password {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.certfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.collect_timing = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.insecure = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.keyfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.region_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.split_loggers = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] glance.timeout = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.backend_availability_zone = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.chap_password = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.chap_username = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.disk_geometry = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.driver_client_cert = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.driver_client_cert_key = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.driver_data_namespace = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.driver_use_ssl = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.extra_capabilities = {} {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.filter_function = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.goodness_function = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.iscsi_target_flags = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.iscsi_write_cache = on {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.iser_helper = tgtadm {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87425) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.iser_ip_address = 192.168.122.15 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.iser_port = 3260 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_host = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_login = admin {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_mount_options = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_password = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_private_key = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_share_path = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.num_shell_tries = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.quobyte_volume_url = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.replication_device = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.report_discard_supported = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.reserved_percentage = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.target_helper = tgtadm {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.target_ip_address = 192.168.122.15 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.target_port = 3260 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.target_protocol = iscsi {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.trace_flags = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.unique_fqdn_network = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.use_chap_auth = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volume_backend_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volume_clear = zero {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volume_clear_ionice = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volume_clear_size = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_reports.file_event_handler = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_reports.log_dir = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.backend_availability_zone = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.backend_host = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.chap_password = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.chap_username = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.chiscsi_conf = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.disk_geometry = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.driver_client_cert = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.driver_data_namespace = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.driver_use_ssl = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.extra_capabilities = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.filter_function = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.goodness_function = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.iser_helper = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.iser_ip_address = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.iser_port = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.iser_target_prefix = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_host = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_login = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_mount_options = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_password = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_private_key = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_share_path = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_ssh_port = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.num_shell_tries = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.nvmet_port_id = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.replication_device = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.report_discard_supported = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.reserved_percentage = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.scst_target_driver = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.storage_protocol = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.target_helper = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.target_ip_address = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.target_port = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.target_prefix = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.target_protocol = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.trace_flags = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.use_chap_auth = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volume_clear = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volume_clear_size = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] QuobyteHD.volumes_dir = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack quobyte-client[87426]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack quobyte-client[87426]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.ssl = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_notifications.driver = [] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_notifications.retry = -1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] key_manager.fixed_key = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.barbican_api_version = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.barbican_endpoint = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.barbican_endpoint_type = public {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.barbican_region_name = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.cafile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.certfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.collect_timing = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.insecure = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.keyfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.number_of_retries = 60 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.retry_delay = 1 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.send_service_user_token = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.split_loggers = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.timeout = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.verify_ssl = True {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican.verify_ssl_path = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.auth_section = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.auth_type = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.cafile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.certfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.collect_timing = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.insecure = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.keyfile = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.split_loggers = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] barbican_service_user.timeout = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.approle_role_id = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.approle_secret_id = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.auth_method = approle {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.auth_path = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.kv_mountpoint = secret {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.kv_path = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.kv_version = 2 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.namespace = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.root_token_id = **** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.ssl_ca_crt_file = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.timeout = 60.0 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.token_file = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.token_role = None {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.use_ssl = False {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:59:43 devstack cinder-volume[87174]: DEBUG oslo_service.backend._eventlet.service [None req-de62b05b-7a92-4c56-bd57-d0e78b7f4cc3 None None] ******************************************************************************** {{(pid=87174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:59:43 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 01:59:43 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:43 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.288s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:43 devstack cinder-volume[87425]: INFO cinder.volume.driver [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.driver [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0264511108398, 'free_capacity_gb': 1774.0264511108398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87425) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_db.sqlalchemy.engines [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87425) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writer thread running {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.db.api [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Building query based on filter {{(pid=87425) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87425) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:43 devstack cinder-volume[87425]: INFO cinder.keymgr.migration [None req-3f29826e-f55e-4c6d-a9cb-1382f3bed518 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:59:43 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 01:59:43 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:43 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Driver initialization completed successfully. Sep 01 01:59:43 devstack cinder-volume[87425]: INFO cinder.manager [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Initiating service 3 cleanup Sep 01 01:59:43 devstack cinder-volume[87425]: INFO cinder.manager [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Service 3 cleanup completed. Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.service [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Creating RPC server for service cinder-volume {{(pid=87425) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.service [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87425) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:59:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 01:59:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:44 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 01:59:44 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:44 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:44 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-10cd69c5-35d9-49d8-9e93-131d08a0e1b3 None None] Driver post RPC initialization completed successfully. Sep 01 01:59:52 devstack cinder-volume[87174]: DEBUG dbcounter [-] [87174] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87174) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:53 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=2 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:59:54 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:00:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 6 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:00:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Flow 'volume_create_manager' (8ee1a698-361f-49f8-8c6f-48145540c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e83226-1937-4714-8dbb-5b7728207ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e83226-1937-4714-8dbb-5b7728207ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-980278636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db4abfc-0d68-4444-9140-9f97c80b3469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e7aa86ab864ba4bd479a6f16f1d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:47Z,use_quota=True,user_id='8edbec7695bc48f497a9022ec3ae8354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48d9cd3-ce66-449f-866e-f60f61d6617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48d9cd3-ce66-449f-866e-f60f61d6617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c540e7-eccb-4bb6-ade5-da491f8f6edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c540e7-eccb-4bb6-ade5-da491f8f6edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db4abfc-0d68-4444-9140-9f97c80b3469', 'volume_name': 'volume-8db4abfc-0d68-4444-9140-9f97c80b3469', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dd1e01-b379-4145-a2bc-752bd40a4793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72dd1e01-b379-4145-a2bc-752bd40a4793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090e8899-ec89-4df1-887a-f980aa4f487e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:46 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Volume 8db4abfc-0d68-4444-9140-9f97c80b3469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db4abfc-0d68-4444-9140-9f97c80b3469', 'volume_size': 1} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-980278636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db4abfc-0d68-4444-9140-9f97c80b3469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e7aa86ab864ba4bd479a6f16f1d6ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:00:47Z,use_quota=True,user_id='8edbec7695bc48f497a9022ec3ae8354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Creating volume 8db4abfc-0d68-4444-9140-9f97c80b3469 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:00:46 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:00:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:46 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 1073741824 Sep 01 02:00:46 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:47 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 1073741824" returned: 0 in 0.743s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:47 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 Sep 01 02:00:47 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:48 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469" returned: 0 in 0.304s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:00:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (090e8899-ec89-4df1-887a-f980aa4f487e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db4abfc-0d68-4444-9140-9f97c80b3469', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9745a22e-0768-4386-b30c-19533f6bd9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:00:48 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Volume volume-8db4abfc-0d68-4444-9140-9f97c80b3469 (8db4abfc-0d68-4444-9140-9f97c80b3469): created successfully Sep 01 02:00:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9745a22e-0768-4386-b30c-19533f6bd9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:00:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Flow 'volume_create_manager' (8ee1a698-361f-49f8-8c6f-48145540c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:00:48 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0a6c72dc-aa06-4cdd-aa06-d4d0a6927d2e tempest-TaggedAttachmentsTest-1953965783 None] Created volume successfully. Sep 01 02:00:58 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:58 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:06 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:01:06 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:06 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.550s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 6 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:01:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Flow 'volume_create_manager' (037ab6ad-75c2-47f0-8f83-1e13cd6982a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5817b13a-4de3-424f-9e9e-d4fc75d89b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5817b13a-4de3-424f-9e9e-d4fc75d89b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-715303714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9963221-df8d-4dd3-b859-16b7fce752fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c52c6f548d41659791695578e79d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:07Z,use_quota=True,user_id='09018028f73449e39947efaabcca1538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb600527-5c91-4674-9d03-96e50a5aa8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb600527-5c91-4674-9d03-96e50a5aa8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158ef1b8-874e-4830-83be-cd4eff880f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158ef1b8-874e-4830-83be-cd4eff880f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9963221-df8d-4dd3-b859-16b7fce752fe', 'volume_name': 'volume-f9963221-df8d-4dd3-b859-16b7fce752fe', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b754e66c-f5d1-41eb-8347-b6adba58b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b754e66c-f5d1-41eb-8347-b6adba58b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab0b362-a585-4dc3-9145-83a79dc966da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:07 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Volume f9963221-df8d-4dd3-b859-16b7fce752fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9963221-df8d-4dd3-b859-16b7fce752fe', 'volume_size': 1} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-715303714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9963221-df8d-4dd3-b859-16b7fce752fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7c52c6f548d41659791695578e79d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:07Z,use_quota=True,user_id='09018028f73449e39947efaabcca1538',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Creating volume f9963221-df8d-4dd3-b859-16b7fce752fe {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:07 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:01:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:07 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe 1073741824 Sep 01 02:01:07 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:08 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe 1073741824" returned: 0 in 1.237s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:09 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe Sep 01 02:01:09 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:09 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe" returned: 0 in 0.699s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab0b362-a585-4dc3-9145-83a79dc966da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9963221-df8d-4dd3-b859-16b7fce752fe', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6d9cd9-f812-4d98-a137-2a73149ecb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Volume volume-f9963221-df8d-4dd3-b859-16b7fce752fe (f9963221-df8d-4dd3-b859-16b7fce752fe): created successfully Sep 01 02:01:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6d9cd9-f812-4d98-a137-2a73149ecb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Flow 'volume_create_manager' (037ab6ad-75c2-47f0-8f83-1e13cd6982a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-51f753d2-746a-4c0b-91c3-b113e464fc27 tempest-DeleteServersTestJSON-522177017 None] Created volume successfully. Sep 01 02:01:16 devstack cinder-volume[87425]: WARNING py.warnings [req-8a58590e-ae2a-46d5-8b26-2f82eee7fc43 req-1f6a9223-7d1a-4a54-8b46-ada6140bf330 tempest-DeleteServersTestJSON-522177017 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 01 02:01:16 devstack cinder-volume[87425]: .first() Sep 01 02:01:16 devstack cinder-volume[87425]: Sep 01 02:01:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-8a58590e-ae2a-46d5-8b26-2f82eee7fc43 req-1f6a9223-7d1a-4a54-8b46-ada6140bf330 tempest-DeleteServersTestJSON-522177017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-8a58590e-ae2a-46d5-8b26-2f82eee7fc43 req-1f6a9223-7d1a-4a54-8b46-ada6140bf330 tempest-DeleteServersTestJSON-522177017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-8a58590e-ae2a-46d5-8b26-2f82eee7fc43 req-1f6a9223-7d1a-4a54-8b46-ada6140bf330 tempest-DeleteServersTestJSON-522177017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-8a58590e-ae2a-46d5-8b26-2f82eee7fc43 req-1f6a9223-7d1a-4a54-8b46-ada6140bf330 tempest-DeleteServersTestJSON-522177017 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-f9963221-df8d-4dd3-b859-16b7fce752fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '015578a7-055a-4f4d-9898-1ac9728c4501', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:01:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-8a58590e-ae2a-46d5-8b26-2f82eee7fc43 req-1f6a9223-7d1a-4a54-8b46-ada6140bf330 tempest-DeleteServersTestJSON-522177017 None] attachment_update completed successfully. Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Flow 'volume_create_manager' (6fffd9ee-1b78-406a-b4ba-b12d1fff3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57643f3d-e619-450a-a030-571084b49177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57643f3d-e619-450a-a030-571084b49177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1450201842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7e713e-2d1f-445e-a19e-75208e6df546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a58669aa3a34742a845e9107222c1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:25Z,use_quota=True,user_id='ece50054dcc34de48a738061e8a02ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7efb18-3199-469a-b08b-8f9ac88142fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7efb18-3199-469a-b08b-8f9ac88142fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb917a2-dec5-4ea7-9a68-19b277c137dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb917a2-dec5-4ea7-9a68-19b277c137dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7e713e-2d1f-445e-a19e-75208e6df546', 'volume_name': 'volume-7d7e713e-2d1f-445e-a19e-75208e6df546', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a66259-9190-4155-b0e8-9e5636f69895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a66259-9190-4155-b0e8-9e5636f69895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b56254-8826-452a-8135-9b1f21d1e6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:25 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Volume 7d7e713e-2d1f-445e-a19e-75208e6df546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7e713e-2d1f-445e-a19e-75208e6df546', 'volume_size': 1} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1450201842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7e713e-2d1f-445e-a19e-75208e6df546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a58669aa3a34742a845e9107222c1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:01:25Z,use_quota=True,user_id='ece50054dcc34de48a738061e8a02ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Creating volume 7d7e713e-2d1f-445e-a19e-75208e6df546 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:01:25 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:25 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 1073741824 Sep 01 02:01:25 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-e2539f83-5b6e-49b9-a4c7-c755bcaa0357 req-cbbfd1b4-dbce-4846-ac89-b2051f7e3e70 tempest-DeleteServersTestJSON-522177017 None] Terminate volume connection completed successfully. Sep 01 02:01:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-e2539f83-5b6e-49b9-a4c7-c755bcaa0357 req-cbbfd1b4-dbce-4846-ac89-b2051f7e3e70 tempest-DeleteServersTestJSON-522177017 None] Deleting attachment 015578a7-055a-4f4d-9898-1ac9728c4501. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:01:26 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 1073741824" returned: 0 in 1.403s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:26 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 Sep 01 02:01:26 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:27 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:01:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b56254-8826-452a-8135-9b1f21d1e6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7e713e-2d1f-445e-a19e-75208e6df546', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0eb795-14bf-4b57-9e05-be9fd2ec2524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:01:27 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Volume volume-7d7e713e-2d1f-445e-a19e-75208e6df546 (7d7e713e-2d1f-445e-a19e-75208e6df546): created successfully Sep 01 02:01:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff0eb795-14bf-4b57-9e05-be9fd2ec2524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:01:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Flow 'volume_create_manager' (6fffd9ee-1b78-406a-b4ba-b12d1fff3559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:01:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-71aca688-76ed-420e-9a7b-9f24fe64859f tempest-VolumesAdminNegativeTest-1280148017 None] Created volume successfully. Sep 01 02:01:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Acquiring lock "cinder-f9963221-df8d-4dd3-b859-16b7fce752fe-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Lock "cinder-f9963221-df8d-4dd3-b859-16b7fce752fe-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Acquiring lock "cinder-quobyte-f9963221-df8d-4dd3-b859-16b7fce752fe" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Lock "cinder-quobyte-f9963221-df8d-4dd3-b859-16b7fce752fe" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:29 devstack cinder-volume[87425]: INFO oslo.privsep.daemon [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzo5sf863/privsep.sock'] Sep 01 02:01:29 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzo5sf863/privsep.sock Sep 01 02:01:29 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Acquiring lock "cinder-7d7e713e-2d1f-445e-a19e-75208e6df546-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Lock "cinder-7d7e713e-2d1f-445e-a19e-75208e6df546-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Acquiring lock "cinder-quobyte-7d7e713e-2d1f-445e-a19e-75208e6df546" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:01:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Lock "cinder-quobyte-7d7e713e-2d1f-445e-a19e-75208e6df546" acquired by "delete_volume" :: waited 0.036s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 02:01:31 devstack cinder-volume[87425]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 02:01:32 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:32 devstack cinder-volume[87425]: INFO oslo.privsep.daemon [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Spawned new privsep daemon via rootwrap Sep 01 02:01:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Accepted privsep connection to /tmp/tmpzo5sf863/privsep.sock {{(pid=87425) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 02:01:32 devstack cinder-volume[87425]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 02:01:32 devstack cinder-volume[87425]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 02:01:32 devstack cinder-volume[87425]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 02:01:32 devstack cinder-volume[87425]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88909 Sep 01 02:01:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[25511956-b468-4d65-a669-7ad06140d355]: (2,) {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:32 devstack cinder-volume[87425]: WARNING oslo_privsep.priv_context [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] privsep daemon already running Sep 01 02:01:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de31fad-d87b-4612-a93b-12238a1a63b2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a229e8-f010-4af4-8851-319404bdcc24]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:01:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:32 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe Sep 01 02:01:32 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:32 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 Sep 01 02:01:32 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:33 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe" returned: 0 in 0.888s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:33 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:33 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe Sep 01 02:01:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546" returned: 0 in 0.945s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:33 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:33 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546 Sep 01 02:01:33 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:33 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9963221-df8d-4dd3-b859-16b7fce752fe" returned: 0 in 0.541s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Lock "cinder-quobyte-f9963221-df8d-4dd3-b859-16b7fce752fe" released by "delete_volume" :: held 4.503s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:33 devstack cinder-volume[87425]: WARNING cinder.quota [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:33 devstack cinder-volume[87425]: WARNING cinder.quota [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Created reservations ['f3bc51bd-c8db-41e8-8782-9154c1cc1233', 'f6b8528e-7083-4d8e-a527-02c6456c85ef', '09bbdc00-b21d-41a0-9310-9737ce5dcdfb', 'd87ce9b6-fce3-42e8-b962-131682cceb22'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:34 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7d7e713e-2d1f-445e-a19e-75208e6df546" returned: 0 in 0.729s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Lock "cinder-quobyte-7d7e713e-2d1f-445e-a19e-75208e6df546" released by "delete_volume" :: held 4.327s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:34 devstack sudo[88930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:01:34 devstack sudo[88930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Created reservations ['4e7000ad-d7e6-4eba-b1e0-bb8d0fbce8fa', 'd75c25c6-54d9-4b16-a65f-4b88953d11f2', 'e6bce159-2029-4a44-9e26-4297926e00b1', '4d73dc45-a4b5-416b-8a8f-cedabbf67dd5'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:34 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:01:34 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:34 devstack sudo[88930]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.369s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Deleted volume successfully. Sep 01 02:01:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d92dcab-239d-491c-9df2-f6c32b61ac80 tempest-DeleteServersTestJSON-522177017 None] Lock "cinder-f9963221-df8d-4dd3-b859-16b7fce752fe-delete_volume" released by "delete_volume" :: held 5.590s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:35 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.412s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:35 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Deleted volume successfully. Sep 01 02:01:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ce9f07e2-27d7-4e92-a5df-cff663265740 tempest-VolumesAdminNegativeTest-1280148017 None] Lock "cinder-7d7e713e-2d1f-445e-a19e-75208e6df546-delete_volume" released by "delete_volume" :: held 5.528s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:01:54 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=28,cinder:SELECT=25,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:54 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=19,cinder:INSERT=4,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:06 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:02:06 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:06 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.399s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-157513bd-e2bc-471a-92ef-9be798e086f0 req-826bb7aa-74a8-4f7a-981e-a0c5ad9c0b66 tempest-TaggedAttachmentsTest-1953965783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-157513bd-e2bc-471a-92ef-9be798e086f0 req-826bb7aa-74a8-4f7a-981e-a0c5ad9c0b66 tempest-TaggedAttachmentsTest-1953965783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-157513bd-e2bc-471a-92ef-9be798e086f0 req-826bb7aa-74a8-4f7a-981e-a0c5ad9c0b66 tempest-TaggedAttachmentsTest-1953965783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-157513bd-e2bc-471a-92ef-9be798e086f0 req-826bb7aa-74a8-4f7a-981e-a0c5ad9c0b66 tempest-TaggedAttachmentsTest-1953965783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-8db4abfc-0d68-4444-9140-9f97c80b3469', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3b2d87f-5031-4c36-a510-8684c62a5311', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:02:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-157513bd-e2bc-471a-92ef-9be798e086f0 req-826bb7aa-74a8-4f7a-981e-a0c5ad9c0b66 tempest-TaggedAttachmentsTest-1953965783 None] attachment_update completed successfully. Sep 01 02:02:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f5ce292f-8d71-49b1-a9c2-ebe3b0a98c3e tempest-GroupSnapshotsV319Test-1897684544 None] Group tempest-GroupSnapshotsV319Test-Group-574593279: creating Sep 01 02:02:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f5ce292f-8d71-49b1-a9c2-ebe3b0a98c3e tempest-GroupSnapshotsV319Test-1897684544 None] Group tempest-GroupSnapshotsV319Test-Group-574593279: created successfully Sep 01 02:02:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f5ce292f-8d71-49b1-a9c2-ebe3b0a98c3e tempest-GroupSnapshotsV319Test-1897684544 None] Create group completed successfully. Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Flow 'volume_create_manager' (182042c5-6beb-46f6-a1bf-bed8235bf804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cbb1cb-68e4-43ea-ae8b-986e0a0d13f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cbb1cb-68e4-43ea-ae8b-986e0a0d13f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-608874176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6dfa0ce-cba3-4fc6-a7a3-bb5386502e1a,host='devstack@QuobyteHD#QuobyteHD',id=8dd56f52-5f7a-4e1a-a389-f2f1dd31a786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1685e6f93bca4533b08dd4e8fdb2afee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:22Z,use_quota=True,user_id='e680a9c985354314a3687493b31ce0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3677aedd-27ab-4d97-a191-9433146c8eeb),volume_type_id=3677aedd-27ab-4d97-a191-9433146c8eeb)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e938bd1f-ece4-4859-bfbb-a07f579aa0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e938bd1f-ece4-4859-bfbb-a07f579aa0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093d60aa-6528-4db5-a5f9-f932ec08b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093d60aa-6528-4db5-a5f9-f932ec08b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd56f52-5f7a-4e1a-a389-f2f1dd31a786', 'volume_name': 'volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11c36d6-e11b-495a-aff2-4dead6f88887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11c36d6-e11b-495a-aff2-4dead6f88887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a9782b-2826-447b-b7ed-25992960f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Volume 8dd56f52-5f7a-4e1a-a389-f2f1dd31a786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786', 'volume_size': 1} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f6dfa0ce-cba3-4fc6-a7a3-bb5386502e1a,created_at=2026-09-01T00:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-608874176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f6dfa0ce-cba3-4fc6-a7a3-bb5386502e1a,host='devstack@QuobyteHD#QuobyteHD',id=8dd56f52-5f7a-4e1a-a389-f2f1dd31a786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1685e6f93bca4533b08dd4e8fdb2afee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:22Z,use_quota=True,user_id='e680a9c985354314a3687493b31ce0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3677aedd-27ab-4d97-a191-9433146c8eeb),volume_type_id=3677aedd-27ab-4d97-a191-9433146c8eeb)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Creating volume 8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:22 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:22 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 1073741824 Sep 01 02:02:22 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-31634c99-6af5-4240-820b-d7b869fa7e58 req-cfe7e40a-1639-4800-871d-736e7d0f2690 tempest-TaggedAttachmentsTest-1953965783 None] Terminate volume connection completed successfully. Sep 01 02:02:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-31634c99-6af5-4240-820b-d7b869fa7e58 req-cfe7e40a-1639-4800-871d-736e7d0f2690 tempest-TaggedAttachmentsTest-1953965783 None] Deleting attachment d3b2d87f-5031-4c36-a510-8684c62a5311. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:02:23 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 1073741824" returned: 0 in 1.513s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:23 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 Sep 01 02:02:23 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:24 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" returned: 0 in 0.932s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] <== create_volume: return (2558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.564s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a9782b-2826-447b-b7ed-25992960f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0bcf30-25c4-4e3c-97f6-f4cfa949a41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:25 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Volume volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 (8dd56f52-5f7a-4e1a-a389-f2f1dd31a786): created successfully Sep 01 02:02:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0bcf30-25c4-4e3c-97f6-f4cfa949a41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Flow 'volume_create_manager' (182042c5-6beb-46f6-a1bf-bed8235bf804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f3792eca-c637-45b7-b82b-aa66653bda73 tempest-GroupSnapshotsV319Test-1897684544 None] Created volume successfully. Sep 01 02:02:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] GroupSnapshot 62be4a7f-f752-400d-93bc-92572e719743: creating. Sep 01 02:02:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Group snapshot 62be4a7f-f752-400d-93bc-92572e719743: creating. {{(pid=87425) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:02:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Creating offline snapshot 5cba32e4-0773-4479-a0f7-38ab441e7db5 of volume 8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:02:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3dcc94-3d20-4d00-a0e9-7048874b04fb]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:28 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 Sep 01 02:02:28 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:29 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" returned: 0 in 1.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:29 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 1G Sep 01 02:02:29 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:31 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 1G" returned: 0 in 1.652s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:31 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 Sep 01 02:02:31 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:32 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5" returned: 0 in 1.292s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:32 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:02:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:32 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 Sep 01 02:02:32 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:32 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5" returned: 0 in 0.493s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:33 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.info Sep 01 02:02:33 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:33 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.info" returned: 0 in 0.823s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:33 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:02:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:33 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.info Sep 01 02:02:33 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:34 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.info" returned: 0 in 0.947s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.884s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Flow 'volume_create_manager' (8615ac69-70fe-4083-b054-a27ee1d11936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5938a37d-962f-45e2-be84-36bf972c421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5938a37d-962f-45e2-be84-36bf972c421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-20948976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfc1efe-9c91-41fe-b232-da7102ef1f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc21a3d78af4320bdd43659f6fccb82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:35Z,use_quota=True,user_id='1296853ed95b4cbdba8c5788f95d8e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cb206b-4f44-432c-9980-088af3281e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cb206b-4f44-432c-9980-088af3281e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4798234-17d3-4f7a-be0d-12693be393b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4798234-17d3-4f7a-be0d-12693be393b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbfc1efe-9c91-41fe-b232-da7102ef1f1d', 'volume_name': 'volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1051be0-7779-4079-9532-8fd84100d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1051be0-7779-4079-9532-8fd84100d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafcb636-3f80-430c-995a-52b84d34202b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:35 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Volume cbfc1efe-9c91-41fe-b232-da7102ef1f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d', 'volume_size': 1} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-20948976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbfc1efe-9c91-41fe-b232-da7102ef1f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc21a3d78af4320bdd43659f6fccb82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:35Z,use_quota=True,user_id='1296853ed95b4cbdba8c5788f95d8e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Creating volume cbfc1efe-9c91-41fe-b232-da7102ef1f1d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:35 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:02:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:35 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d 1073741824 Sep 01 02:02:35 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9633a2a8-559c-4d8e-8545-2ceb5de3cfed tempest-GroupSnapshotsV319Test-1897684544 None] group_snapshot 62be4a7f-f752-400d-93bc-92572e719743: created successfully Sep 01 02:02:36 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d 1073741824" returned: 0 in 0.950s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:36 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d Sep 01 02:02:36 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:36 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d" returned: 0 in 0.507s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cafcb636-3f80-430c-995a-52b84d34202b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49be313-f982-4406-bb58-de99cdd6c86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:36 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Volume volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d (cbfc1efe-9c91-41fe-b232-da7102ef1f1d): created successfully Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49be313-f982-4406-bb58-de99cdd6c86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Flow 'volume_create_manager' (8615ac69-70fe-4083-b054-a27ee1d11936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1c2c12b6-5640-4d9a-acb6-d08900f0d006 tempest-ServerRescueNegativeTestJSON-699103607 None] Created volume successfully. Sep 01 02:02:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] group_snapshot 62be4a7f-f752-400d-93bc-92572e719743: deleting Sep 01 02:02:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] group_snapshot 62be4a7f-f752-400d-93bc-92572e719743: deleting {{(pid=87425) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:02:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Acquiring lock "cinder-quobyte-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "cinder-quobyte-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" acquired by "delete_snapshot" :: waited 0.102s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Acquiring lock "cinder-quobyte-5cba32e4-0773-4479-a0f7-38ab441e7db5" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "cinder-quobyte-5cba32e4-0773-4479-a0f7-38ab441e7db5" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Deleting offline snapshot 5cba32e4-0773-4479-a0f7-38ab441e7db5 of volume 8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:02:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] snapshot_file for this snap is: volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:02:38 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cd10a6-6775-41d2-81c3-198f426ab7f6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:38 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 Sep 01 02:02:38 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:39 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5" returned: 0 in 1.046s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:02:39 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1166d830-fc19-4b8f-b2ee-d488a900ee29]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:39 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 Sep 01 02:02:39 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:40 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" returned: 0 in 0.833s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:40 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 Sep 01 02:02:40 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:41 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5" returned: 0 in 1.205s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:41 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5 Sep 01 02:02:41 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:41 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786.5cba32e4-0773-4479-a0f7-38ab441e7db5" returned: 0 in 0.628s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "cinder-quobyte-5cba32e4-0773-4479-a0f7-38ab441e7db5" released by "_delete_snapshot" :: held 4.046s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "cinder-quobyte-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" released by "delete_snapshot" :: held 4.143s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:42 devstack cinder-volume[87425]: WARNING cinder.quota [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-479362247 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-479362247, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:02:42 devstack cinder-volume[87425]: WARNING cinder.quota [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-479362247 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-479362247, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:02:42 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] Created reservations ['39725e5d-4f71-4e29-821d-f1f7328f062b', '941b9b8b-31aa-4a19-9025-bbe665994cd5', '055ad90a-68ce-4edc-9343-db40bccfc616', '77a9de9c-99d6-481d-a62b-84ca8cebadd8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5b5a43c3-72c0-473a-8742-99f374e78522 tempest-GroupSnapshotsV319Test-1897684544 None] group_snapshot 62be4a7f-f752-400d-93bc-92572e719743: deleted successfully Sep 01 02:02:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Acquiring lock "cinder-quobyte-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "cinder-quobyte-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1c2906-f4d3-4dd4-858c-b745e8c5d9f4]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:44 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 Sep 01 02:02:44 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:45 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" returned: 0 in 1.143s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:45 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786 Sep 01 02:02:45 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:46 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" returned: 0 in 1.139s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "cinder-quobyte-8dd56f52-5f7a-4e1a-a389-f2f1dd31a786" released by "delete_volume" :: held 2.423s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Created reservations ['ef63ecd9-4a74-49ab-b085-884833ac3c10'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:46 devstack cinder-volume[87425]: WARNING cinder.quota [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-479362247 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-479362247, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Created reservations ['4d59bcf4-1291-4358-b9cc-f06a95e9998b', '95ba6ae7-c214-429d-a8a2-68ecaf50b052', 'c5c0d805-9c8e-4b7e-8407-2242457a2091', 'fc208595-16e5-4ef9-a913-6221c0cab8fd'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:47 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:02:47 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:47 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.913s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:47 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8d0ee893-cf21-45c1-bfe0-c500d678e383 tempest-GroupSnapshotsV319Test-1897684544 None] Delete group completed successfully. Sep 01 02:02:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Acquiring lock "cinder-8db4abfc-0d68-4444-9140-9f97c80b3469-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Lock "cinder-8db4abfc-0d68-4444-9140-9f97c80b3469-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Acquiring lock "cinder-quobyte-8db4abfc-0d68-4444-9140-9f97c80b3469" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Lock "cinder-quobyte-8db4abfc-0d68-4444-9140-9f97c80b3469" acquired by "delete_volume" :: waited 0.049s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58d9dcf-39a6-4a07-8e88-3bc14673cd3f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 Sep 01 02:02:50 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:50 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469" returned: 0 in 0.807s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469 Sep 01 02:02:50 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:51 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8db4abfc-0d68-4444-9140-9f97c80b3469" returned: 0 in 0.348s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Lock "cinder-quobyte-8db4abfc-0d68-4444-9140-9f97c80b3469" released by "delete_volume" :: held 1.219s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Created reservations ['8c960bb7-fcaf-4300-a49f-610f33104a82', 'fff6ea08-1861-4604-931e-fded41fe638b', '275d1e72-df73-49bd-8bee-7ec54b18ab4d', 'ad78a697-5beb-4efb-9dda-77cba8a4ca3b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:51 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:02:51 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:51 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.304s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:51 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Deleted volume successfully. Sep 01 02:02:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7d2d7294-e7ac-4725-aee3-3c2416eabe64 tempest-TaggedAttachmentsTest-1953965783 None] Lock "cinder-8db4abfc-0d68-4444-9140-9f97c80b3469-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Acquiring lock "cinder-cbfc1efe-9c91-41fe-b232-da7102ef1f1d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "cinder-cbfc1efe-9c91-41fe-b232-da7102ef1f1d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Acquiring lock "cinder-quobyte-cbfc1efe-9c91-41fe-b232-da7102ef1f1d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "cinder-quobyte-cbfc1efe-9c91-41fe-b232-da7102ef1f1d" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:54 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d49268-8768-4340-9780-7ce0f4e2602f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:54 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d Sep 01 02:02:54 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:54 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d" returned: 0 in 0.572s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:54 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d Sep 01 02:02:54 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:55 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cbfc1efe-9c91-41fe-b232-da7102ef1f1d" returned: 0 in 0.367s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "cinder-quobyte-cbfc1efe-9c91-41fe-b232-da7102ef1f1d" released by "delete_volume" :: held 1.011s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Created reservations ['f0f43f37-e141-49a7-b1b4-48156835be8a', '1130ce69-8d00-4c5d-8555-2c96bec7f07d', 'a75f7b98-8f81-451a-a017-9e2d8f514d24', 'ea352757-f091-4edc-9db8-a2fea203c5d4'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:55 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:02:55 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:56 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.458s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:56 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Deleted volume successfully. Sep 01 02:02:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7203defd-df21-4a4a-9fba-b18626d85521 tempest-ServerRescueNegativeTestJSON-699103607 None] Lock "cinder-cbfc1efe-9c91-41fe-b232-da7102ef1f1d-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Flow 'volume_create_manager' (58ffe2a6-2b91-431a-a421-bea4902a8d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0f4f6c-9f9a-4c27-9248-f8a55f68f6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b0f4f6c-9f9a-4c27-9248-f8a55f68f6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1177746763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98561eaf-ef3d-4f0f-8fb2-68bd924bfa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175665b91a9642c6a7c0cd25c5fad375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:01Z,use_quota=True,user_id='1334440cfd684d8288d24ee265771d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ec9017-1eba-4559-9238-1cf99e23a36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ec9017-1eba-4559-9238-1cf99e23a36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c50b9b5-492b-4777-b008-85c5adf85eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c50b9b5-492b-4777-b008-85c5adf85eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98561eaf-ef3d-4f0f-8fb2-68bd924bfa52', 'volume_name': 'volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10a6edc-a7e7-4431-ad70-56a2369c8cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10a6edc-a7e7-4431-ad70-56a2369c8cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd3297e-46b8-4446-a8f6-9ad1418a5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:01 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Volume 98561eaf-ef3d-4f0f-8fb2-68bd924bfa52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52', 'volume_size': 1} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1177746763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98561eaf-ef3d-4f0f-8fb2-68bd924bfa52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175665b91a9642c6a7c0cd25c5fad375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:01Z,use_quota=True,user_id='1334440cfd684d8288d24ee265771d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Creating volume 98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:01 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:01 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 1073741824 Sep 01 02:03:01 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:01 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Flow 'volume_create_manager' (b4add1a0-5a0f-4241-b093-f55bc4ad2e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc6340c-d8a6-4813-a630-232f363b21da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc6340c-d8a6-4813-a630-232f363b21da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2145184275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce017c8-f788-480e-b036-571cbd5bfe9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abe18e7eddb41939796abbee3e9b3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:02Z,use_quota=True,user_id='d9e34203d3b540b3aa5006dab352aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8a52dc-98f0-4175-9628-c816cfedc134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8a52dc-98f0-4175-9628-c816cfedc134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a832c0-f0e8-4c81-927b-81acac646733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a832c0-f0e8-4c81-927b-81acac646733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce017c8-f788-480e-b036-571cbd5bfe9a', 'volume_name': 'volume-9ce017c8-f788-480e-b036-571cbd5bfe9a', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614687fa-7fe4-453c-baab-bc72e9f17065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614687fa-7fe4-453c-baab-bc72e9f17065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf20621-e92b-4573-b9f9-3b2d855d8462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Volume 9ce017c8-f788-480e-b036-571cbd5bfe9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce017c8-f788-480e-b036-571cbd5bfe9a', 'volume_size': 1} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:02 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 1073741824" returned: 0 in 0.835s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:02 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 Sep 01 02:03:02 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:02 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52" returned: 0 in 0.299s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2145184275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce017c8-f788-480e-b036-571cbd5bfe9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abe18e7eddb41939796abbee3e9b3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:02Z,use_quota=True,user_id='d9e34203d3b540b3aa5006dab352aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Creating volume 9ce017c8-f788-480e-b036-571cbd5bfe9a {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:02 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccd3297e-46b8-4446-a8f6-9ad1418a5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fb9ffa-a96f-4fce-983e-b6fa49f08953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:02 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a 1073741824 Sep 01 02:03:02 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:02 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Volume volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 (98561eaf-ef3d-4f0f-8fb2-68bd924bfa52): created successfully Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fb9ffa-a96f-4fce-983e-b6fa49f08953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Flow 'volume_create_manager' (58ffe2a6-2b91-431a-a421-bea4902a8d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:02 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-43671cbc-89bc-4e8d-b780-bbe7c536df1e tempest-ServerActionsTestOtherA-1855892746 None] Created volume successfully. Sep 01 02:03:03 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a 1073741824" returned: 0 in 0.639s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:03 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a Sep 01 02:03:03 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:03 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a" returned: 0 in 0.349s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cf20621-e92b-4573-b9f9-3b2d855d8462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce017c8-f788-480e-b036-571cbd5bfe9a', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd15f469-a89f-4932-a21b-38a2ddc63813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:03 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Volume volume-9ce017c8-f788-480e-b036-571cbd5bfe9a (9ce017c8-f788-480e-b036-571cbd5bfe9a): created successfully Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd15f469-a89f-4932-a21b-38a2ddc63813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Flow 'volume_create_manager' (b4add1a0-5a0f-4241-b093-f55bc4ad2e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:03 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ed7f5910-3a57-4c65-82e0-e89566cacdea tempest-VolumeQuotasAdminTestJSON-866042066 None] Created volume successfully. Sep 01 02:03:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Acquiring lock "cinder-9ce017c8-f788-480e-b036-571cbd5bfe9a-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "cinder-9ce017c8-f788-480e-b036-571cbd5bfe9a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Acquiring lock "cinder-quobyte-9ce017c8-f788-480e-b036-571cbd5bfe9a" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "cinder-quobyte-9ce017c8-f788-480e-b036-571cbd5bfe9a" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:04 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[192f3275-bfa0-444d-a46d-eaf82eebe896]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:04 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a Sep 01 02:03:04 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:05 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a" returned: 0 in 0.671s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:05 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a Sep 01 02:03:05 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:05 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9ce017c8-f788-480e-b036-571cbd5bfe9a" returned: 0 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "cinder-quobyte-9ce017c8-f788-480e-b036-571cbd5bfe9a" released by "delete_volume" :: held 1.113s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Created reservations ['ed77a2e0-a906-4590-9181-d3b22b2e9a06', '16aba6a3-b541-4e6b-97b0-c8b7a1e308b1', '72ddd8aa-66c8-4fae-8e0b-2f4a9e7b2ac1', '3199f4be-893e-4be7-af69-76752bb91b41'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:05 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:03:05 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:05 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.280s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:05 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Deleted volume successfully. Sep 01 02:03:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-17209ffe-3ad7-40d0-8dc2-da8215b4ea76 tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "cinder-9ce017c8-f788-480e-b036-571cbd5bfe9a-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:06 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:03:06 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:06 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.386s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 8 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:03:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Flow 'volume_create_manager' (5526fd24-da2b-47ad-9340-4a35f7df2a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf77a05-36bc-4ad8-b736-4e13f9a4c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf77a05-36bc-4ad8-b736-4e13f9a4c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-298438709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60681338-381b-4382-aad7-7a440cfc140a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abe18e7eddb41939796abbee3e9b3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:07Z,use_quota=True,user_id='d9e34203d3b540b3aa5006dab352aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e865ced-138c-4e13-9e32-4fb57f3d81e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e865ced-138c-4e13-9e32-4fb57f3d81e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5976965a-7c30-409a-a6a9-b9f102a99296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5976965a-7c30-409a-a6a9-b9f102a99296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60681338-381b-4382-aad7-7a440cfc140a', 'volume_name': 'volume-60681338-381b-4382-aad7-7a440cfc140a', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4adb06d-fafd-46c8-b68b-b394c8a1e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4adb06d-fafd-46c8-b68b-b394c8a1e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71fc8a5-9d9f-4b4b-a088-b2e4f3b28b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Volume 60681338-381b-4382-aad7-7a440cfc140a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60681338-381b-4382-aad7-7a440cfc140a', 'volume_size': 1} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-298438709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60681338-381b-4382-aad7-7a440cfc140a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8abe18e7eddb41939796abbee3e9b3de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:07Z,use_quota=True,user_id='d9e34203d3b540b3aa5006dab352aa05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Creating volume 60681338-381b-4382-aad7-7a440cfc140a {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:07 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:03:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:07 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a 1073741824 Sep 01 02:03:07 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:08 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a 1073741824" returned: 0 in 0.617s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:08 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a Sep 01 02:03:08 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:08 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a" returned: 0 in 0.318s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71fc8a5-9d9f-4b4b-a088-b2e4f3b28b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60681338-381b-4382-aad7-7a440cfc140a', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605c4883-1105-4844-b5fb-7f70b363a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Volume volume-60681338-381b-4382-aad7-7a440cfc140a (60681338-381b-4382-aad7-7a440cfc140a): created successfully Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605c4883-1105-4844-b5fb-7f70b363a035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Flow 'volume_create_manager' (5526fd24-da2b-47ad-9340-4a35f7df2a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-01528fac-4ace-48bc-962a-14d19d54b99d tempest-VolumeQuotasAdminTestJSON-866042066 None] Created volume successfully. Sep 01 02:03:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1218547c-8538-4723-be0d-cff400443284 tempest-VolumeQuotasAdminTestJSON-991765051 None] Transfer volume completed successfully. Sep 01 02:03:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Acquiring lock "cinder-60681338-381b-4382-aad7-7a440cfc140a-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Lock "cinder-60681338-381b-4382-aad7-7a440cfc140a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Acquiring lock "cinder-quobyte-60681338-381b-4382-aad7-7a440cfc140a" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Lock "cinder-quobyte-60681338-381b-4382-aad7-7a440cfc140a" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:11 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2097bb-88de-4989-afc6-ea9ddc2b19db]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:11 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a Sep 01 02:03:11 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:12 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a" returned: 0 in 0.575s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:12 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a Sep 01 02:03:12 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:12 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-60681338-381b-4382-aad7-7a440cfc140a" returned: 0 in 0.331s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Lock "cinder-quobyte-60681338-381b-4382-aad7-7a440cfc140a" released by "delete_volume" :: held 0.989s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Created reservations ['1a0687cf-5daa-416e-868e-08e31f06c3ec', '876658de-12e6-45c6-9dcd-50b7edfdd8d6', 'd4486e5a-7a61-44dd-89b2-6bebde0dc653', 'ff938707-7328-4417-b4f6-07186b175b27'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:12 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:03:12 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:13 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.367s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:13 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Deleted volume successfully. Sep 01 02:03:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-624e1dc8-d22e-40b7-9b11-b4f5264007b4 tempest-VolumeQuotasAdminTestJSON-821439049 None] Lock "cinder-60681338-381b-4382-aad7-7a440cfc140a-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:20 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=58,cinder:UPDATE=76,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0abb72af-fd73-4765-b3e8-18e7a111321b tempest-GroupSnapshotsTest-637258634 None] Group tempest-GroupSnapshotsTest-Group-1417523098: creating Sep 01 02:03:20 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=65,cinder:UPDATE=61,cinder:DELETE=7,cinder:INSERT=17 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0abb72af-fd73-4765-b3e8-18e7a111321b tempest-GroupSnapshotsTest-637258634 None] Group tempest-GroupSnapshotsTest-Group-1417523098: created successfully Sep 01 02:03:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0abb72af-fd73-4765-b3e8-18e7a111321b tempest-GroupSnapshotsTest-637258634 None] Create group completed successfully. Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Flow 'volume_create_manager' (3b23d9fb-0833-4ee9-ba08-732023730285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef6051c-a3f3-4822-94d5-f999dabdea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef6051c-a3f3-4822-94d5-f999dabdea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1169206253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c5d73f9-ec44-4e2f-b38c-ca26199648f8,host='devstack@QuobyteHD#QuobyteHD',id=a3076a3e-aa0c-44c4-8777-38de1db23b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40834eb1cc1943888ee121f521ffea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:23Z,use_quota=True,user_id='da7e39ddcd324f0b9119bed456b73692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(522f2b4e-fe9f-4513-a869-405d290bc7f8),volume_type_id=522f2b4e-fe9f-4513-a869-405d290bc7f8)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b89a63-9632-41e2-9747-86d2c718f66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b89a63-9632-41e2-9747-86d2c718f66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128c1d2b-5552-4a17-bc58-0a2413fb00f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128c1d2b-5552-4a17-bc58-0a2413fb00f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3076a3e-aa0c-44c4-8777-38de1db23b14', 'volume_name': 'volume-a3076a3e-aa0c-44c4-8777-38de1db23b14', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ab4851-ff6b-4510-bb41-9f01a5698e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ab4851-ff6b-4510-bb41-9f01a5698e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a248c6d8-1ddb-4231-9f87-0dc7c40a4c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Volume a3076a3e-aa0c-44c4-8777-38de1db23b14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3076a3e-aa0c-44c4-8777-38de1db23b14', 'volume_size': 1} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0c5d73f9-ec44-4e2f-b38c-ca26199648f8,created_at=2026-09-01T00:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1169206253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c5d73f9-ec44-4e2f-b38c-ca26199648f8,host='devstack@QuobyteHD#QuobyteHD',id=a3076a3e-aa0c-44c4-8777-38de1db23b14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40834eb1cc1943888ee121f521ffea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:23Z,use_quota=True,user_id='da7e39ddcd324f0b9119bed456b73692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(522f2b4e-fe9f-4513-a869-405d290bc7f8),volume_type_id=522f2b4e-fe9f-4513-a869-405d290bc7f8)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Creating volume a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:23 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:03:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:23 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 1073741824 Sep 01 02:03:23 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:24 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 1073741824" returned: 0 in 0.879s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:24 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 Sep 01 02:03:24 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:24 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14" returned: 0 in 0.616s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a248c6d8-1ddb-4231-9f87-0dc7c40a4c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3076a3e-aa0c-44c4-8777-38de1db23b14', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560fbb9-da83-479f-95fa-e062a8f4e2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:24 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Volume volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 (a3076a3e-aa0c-44c4-8777-38de1db23b14): created successfully Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9560fbb9-da83-479f-95fa-e062a8f4e2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Flow 'volume_create_manager' (3b23d9fb-0833-4ee9-ba08-732023730285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-462c9bef-bbd0-48f9-bc28-e4adbdfe12e7 tempest-GroupSnapshotsTest-637258634 None] Created volume successfully. Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Flow 'volume_create_manager' (2404b768-61a2-4fe4-a55b-bb2854d260df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d468444-a7e6-4801-9da9-a6142d13e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d468444-a7e6-4801-9da9-a6142d13e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-596781798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06428ba8-2e30-4325-afac-c81113687311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8183faf06d6248b0a506a53e6badb829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:26Z,use_quota=True,user_id='e78cdf5a16264ecfafa654f3a1f269a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0edafb-731e-4654-8730-4dcec1fb8bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0edafb-731e-4654-8730-4dcec1fb8bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347a319a-3b0e-4e72-a4bb-c39c4ebb673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347a319a-3b0e-4e72-a4bb-c39c4ebb673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06428ba8-2e30-4325-afac-c81113687311', 'volume_name': 'volume-06428ba8-2e30-4325-afac-c81113687311', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c52ee2-c077-44d1-a57a-2cf39b574201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c52ee2-c077-44d1-a57a-2cf39b574201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af80863-ac96-43bb-979d-591136699d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:26 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Volume 06428ba8-2e30-4325-afac-c81113687311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06428ba8-2e30-4325-afac-c81113687311', 'volume_size': 1} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-596781798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06428ba8-2e30-4325-afac-c81113687311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8183faf06d6248b0a506a53e6badb829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:26Z,use_quota=True,user_id='e78cdf5a16264ecfafa654f3a1f269a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Creating volume 06428ba8-2e30-4325-afac-c81113687311 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:26 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:26 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 1073741824 Sep 01 02:03:26 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] GroupSnapshot 062d2b6d-d722-42ab-9be2-e1a562b92459: creating. Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Group snapshot 062d2b6d-d722-42ab-9be2-e1a562b92459: creating. {{(pid=87425) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:03:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:27 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 1073741824" returned: 0 in 0.698s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:27 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 Sep 01 02:03:27 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:27 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311" returned: 0 in 0.262s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.778s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Creating offline snapshot cf68d128-3845-49b2-ab96-27d057f4d8db of volume a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af80863-ac96-43bb-979d-591136699d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06428ba8-2e30-4325-afac-c81113687311', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964ec330-8d9c-4019-af8a-dc442852d9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a863c6-e923-4f44-84a3-1ef4b7f5b9fb]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:27 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Volume volume-06428ba8-2e30-4325-afac-c81113687311 (06428ba8-2e30-4325-afac-c81113687311): created successfully Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964ec330-8d9c-4019-af8a-dc442852d9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Flow 'volume_create_manager' (2404b768-61a2-4fe4-a55b-bb2854d260df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-2398cea1-ba46-409b-a0c5-decc9b0e066c tempest-VolumesServicesTestJSON-159847735 None] Created volume successfully. Sep 01 02:03:27 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 Sep 01 02:03:27 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:28 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14" returned: 0 in 0.515s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:28 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db 1G Sep 01 02:03:28 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Acquiring lock "cinder-06428ba8-2e30-4325-afac-c81113687311-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Lock "cinder-06428ba8-2e30-4325-afac-c81113687311-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:29 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db 1G" returned: 0 in 0.831s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:29 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db Sep 01 02:03:29 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Acquiring lock "cinder-quobyte-06428ba8-2e30-4325-afac-c81113687311" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Lock "cinder-quobyte-06428ba8-2e30-4325-afac-c81113687311" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a063a30-5d97-4206-933f-a009dafe0861]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:29 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 Sep 01 02:03:29 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:29 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db" returned: 0 in 0.552s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:29 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:29 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db Sep 01 02:03:29 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:29 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311" returned: 0 in 0.607s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:29 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311 Sep 01 02:03:29 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:30 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db" returned: 0 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:30 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.info Sep 01 02:03:30 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:30 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-06428ba8-2e30-4325-afac-c81113687311" returned: 0 in 0.441s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Lock "cinder-quobyte-06428ba8-2e30-4325-afac-c81113687311" released by "delete_volume" :: held 1.126s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Created reservations ['b3f97e33-3329-43e8-8e27-44fef103ec44', '5df370d6-70e6-4dbf-bf0b-74782a114c83', 'de7ec3cb-896e-49ac-8e12-a036f28043b2', '9357da9d-9762-4c04-a1dc-d13f515131b2'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:30 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.info" returned: 0 in 0.428s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:30 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:30 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.info Sep 01 02:03:30 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:30 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:03:30 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:30 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.306s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Deleted volume successfully. Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9b716a4e-a30b-42c4-9e28-fcb76a595dba tempest-VolumesServicesTestJSON-159847735 None] Lock "cinder-06428ba8-2e30-4325-afac-c81113687311-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:30 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.info" returned: 0 in 0.511s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.375s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0e32e3fb-e86e-4b41-bd73-5cbfe0d66238 tempest-GroupSnapshotsTest-637258634 None] group_snapshot 062d2b6d-d722-42ab-9be2-e1a562b92459: created successfully Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-cf68d128-3845-49b2-ab96-27d057f4d8db-bbe70295-ec2b-4ff8-befe-15efac393b1a" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-cf68d128-3845-49b2-ab96-27d057f4d8db-bbe70295-ec2b-4ff8-befe-15efac393b1a" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Creating volume bbe70295-ec2b-4ff8-befe-15efac393b1a from snapshot cf68d128-3845-49b2-ab96-27d057f4d8db {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-bbe70295-ec2b-4ff8-befe-15efac393b1a" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-bbe70295-ec2b-4ff8-befe-15efac393b1a" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] snapshot: cf68d128-3845-49b2-ab96-27d057f4d8db, volume: bbe70295-ec2b-4ff8-befe-15efac393b1a, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d8864d-0c2b-4b3d-b8a0-d67884f12894]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:33 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db Sep 01 02:03:33 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:34 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db" returned: 0 in 0.674s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3076a3e-aa0c-44c4-8777-38de1db23b14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ba3603-88c2-424e-a0fc-2ae084b43118]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:34 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 Sep 01 02:03:34 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:34 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14" returned: 0 in 0.517s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:03:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:34 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a Sep 01 02:03:34 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:41 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a" returned: 0 in 6.803s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:41 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:03:41 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Converted 1024.00 MB image at 150.48 MB/s Sep 01 02:03:41 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:03:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:41 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a Sep 01 02:03:41 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:41 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a" returned: 0 in 0.380s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-bbe70295-ec2b-4ff8-befe-15efac393b1a" released by "_copy_volume_from_snapshot" :: held 8.542s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-cf68d128-3845-49b2-ab96-27d057f4d8db-bbe70295-ec2b-4ff8-befe-15efac393b1a" released by "_create_volume_from_snapshot" :: held 8.692s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.736s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e4e6be43-186d-49e9-95c4-151d8274175a tempest-GroupSnapshotsTest-637258634 None] Create group from source-snapshot-062d2b6d-d722-42ab-9be2-e1a562b92459 completed successfully. Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-bbe70295-ec2b-4ff8-befe-15efac393b1a" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-bbe70295-ec2b-4ff8-befe-15efac393b1a" acquired by "delete_volume" :: waited 0.040s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af1fa0b-8ae4-4c15-b08a-4465afa4ad48]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Flow 'volume_create_manager' (4f12de8c-b45a-4c5b-ba5b-c312b32910c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c442e843-fb8d-46da-bdf5-645b6252a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c442e843-fb8d-46da-bdf5-645b6252a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-140966413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa89f15b-e2c4-4688-8326-9100cf8bfd72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abff565f3b094c898875ab1b02162b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:44Z,use_quota=True,user_id='8f31bc2e5dc24b2fa69e7e85cf7f17ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1467f94-893c-4203-9270-1a56f158495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1467f94-893c-4203-9270-1a56f158495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4ddffd-39ce-48ba-b934-6c6f3e56c8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:43 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:03:43 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a Sep 01 02:03:43 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:44 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a" returned: 0 in 0.562s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:44 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a Sep 01 02:03:44 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4ddffd-39ce-48ba-b934-6c6f3e56c8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa89f15b-e2c4-4688-8326-9100cf8bfd72', 'volume_name': 'volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4065fea-7acd-4f40-a2f0-195003544067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4065fea-7acd-4f40-a2f0-195003544067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0223e70f-eacb-4840-907d-3248c29bb23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:44 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Volume fa89f15b-e2c4-4688-8326-9100cf8bfd72: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Trying to clone fa89f15b-e2c4-4688-8326-9100cf8bfd72 from image 694eb3d8-3f60-4f10-a358-172d9ec581ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:03:44 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bbe70295-ec2b-4ff8-befe-15efac393b1a" returned: 0 in 0.355s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-bbe70295-ec2b-4ff8-befe-15efac393b1a" released by "delete_volume" :: held 1.023s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:03:45 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['1d49498f-d5e2-4ef7-bed5-dd236dd98994'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a365be-e048-4d68-997a-03759c892da7]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:45 devstack cinder-volume[87425]: WARNING cinder.quota [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1349617335 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1349617335, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:03:45 devstack cinder-volume[87425]: WARNING cinder.quota [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1349617335 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1349617335, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['935ccaf6-74d9-4ba8-9d1d-c310df14ea77', 'f0d31f21-c24d-44d1-94c6-60ae15684ecd', 'f0d079c1-8bcd-4940-893b-cac4278bfe48', '62865da5-8654-4eb3-8618-f1738247cf42'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:45 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD Sep 01 02:03:45 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:45 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:03:45 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:45 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD" returned: 0 in 0.807s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:45 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff is fetched for user 8f31bc2e5dc24b2fa69e7e85cf7f17ca. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bd01bf-538b-4589-ad3a-bf060748c857]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:46 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.691s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-61cbcf2c-7ac9-4d99-a5d1-4040a0106179 tempest-GroupSnapshotsTest-637258634 None] Delete group completed successfully. Sep 01 02:03:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] group_snapshot 062d2b6d-d722-42ab-9be2-e1a562b92459: deleting Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] group_snapshot 062d2b6d-d722-42ab-9be2-e1a562b92459: deleting {{(pid=87425) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:03:46 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD Sep 01 02:03:46 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-a3076a3e-aa0c-44c4-8777-38de1db23b14" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-a3076a3e-aa0c-44c4-8777-38de1db23b14" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-cf68d128-3845-49b2-ab96-27d057f4d8db" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-cf68d128-3845-49b2-ab96-27d057f4d8db" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Deleting offline snapshot cf68d128-3845-49b2-ab96-27d057f4d8db of volume a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] snapshot_file for this snap is: volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b288bb66-1c6d-41b3-a1bd-bb5b28be10d1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:47 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db Sep 01 02:03:47 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:47 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD" returned: 0 in 0.958s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-140966413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa89f15b-e2c4-4688-8326-9100cf8bfd72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abff565f3b094c898875ab1b02162b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:44Z,use_quota=True,user_id='8f31bc2e5dc24b2fa69e7e85cf7f17ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Creating volume fa89f15b-e2c4-4688-8326-9100cf8bfd72 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:47 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:47 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 1073741824 Sep 01 02:03:47 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:47 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db" returned: 0 in 1.009s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3076a3e-aa0c-44c4-8777-38de1db23b14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff11ed04-eaa3-4c18-a522-c7899024baff]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:48 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 Sep 01 02:03:48 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:48 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 1073741824" returned: 0 in 0.833s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:48 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 Sep 01 02:03:48 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:48 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72" returned: 0 in 0.460s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Attempting download of 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume fa89f15b-e2c4-4688-8326-9100cf8bfd72. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:03:48 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14" returned: 0 in 0.876s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:48 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db Sep 01 02:03:48 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d350a7-26c3-4f89-a2c6-74d87bd56ce8]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_3orqmn7u {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-e246b3d3-8963-472d-8109-51c1b7e99275 req-50dbdedf-632f-49a4-80f3-bfd14dc66fc4 tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-e246b3d3-8963-472d-8109-51c1b7e99275 req-50dbdedf-632f-49a4-80f3-bfd14dc66fc4 tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-e246b3d3-8963-472d-8109-51c1b7e99275 req-50dbdedf-632f-49a4-80f3-bfd14dc66fc4 tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-e246b3d3-8963-472d-8109-51c1b7e99275 req-50dbdedf-632f-49a4-80f3-bfd14dc66fc4 tempest-ServerActionsTestOtherA-1855892746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80ba1a4b-72a1-44ea-b68f-d95772cf2e4c', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:03:49 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-e246b3d3-8963-472d-8109-51c1b7e99275 req-50dbdedf-632f-49a4-80f3-bfd14dc66fc4 tempest-ServerActionsTestOtherA-1855892746 None] attachment_update completed successfully. Sep 01 02:03:49 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_3orqmn7u Sep 01 02:03:49 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:49 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_3orqmn7u" returned: 0 in 0.682s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_3orqmn7u {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:49 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db" returned: 0 in 0.804s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:49 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db Sep 01 02:03:49 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:49 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_3orqmn7u Sep 01 02:03:49 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:49 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14.cf68d128-3845-49b2-ab96-27d057f4d8db" returned: 0 in 0.410s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:50 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_3orqmn7u" returned: 1 in 0.545s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_3orqmn7u' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-cf68d128-3845-49b2-ab96-27d057f4d8db" released by "_delete_snapshot" :: held 3.310s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[07545c36-9798-4b53-9aed-6f36332a9adf]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-a3076a3e-aa0c-44c4-8777-38de1db23b14" released by "delete_snapshot" :: held 3.368s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:50 devstack cinder-volume[87425]: WARNING cinder.quota [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1349617335 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1349617335, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:03:50 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD Sep 01 02:03:50 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] Created reservations ['5b0752b4-a5d7-4fae-9dfe-0f7550019fe3', '4307ff81-e723-4d00-bca7-c972851ce0a7', '1d08bdc6-a09b-463b-9e08-f38312dd335a', '899b2f1e-e679-4402-ae3f-14e7115b7dc7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:50 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-829174f9-ce23-40b6-aea4-63e4d1c086dc tempest-GroupSnapshotsTest-637258634 None] group_snapshot 062d2b6d-d722-42ab-9be2-e1a562b92459: deleted successfully Sep 01 02:03:50 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD" returned: 0 in 0.717s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] 694eb3d8-3f60-4f10-a358-172d9ec581ff was qcow2, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:03:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:50 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 Sep 01 02:03:50 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-a3076a3e-aa0c-44c4-8777-38de1db23b14" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-a3076a3e-aa0c-44c4-8777-38de1db23b14" acquired by "delete_volume" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:52 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4cae0d-3f44-457d-a58f-53126048b91a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:52 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 Sep 01 02:03:52 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:52 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14" returned: 0 in 0.651s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:52 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14 Sep 01 02:03:52 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:53 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3076a3e-aa0c-44c4-8777-38de1db23b14" returned: 0 in 0.829s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-a3076a3e-aa0c-44c4-8777-38de1db23b14" released by "delete_volume" :: held 1.679s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:53 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['501509c6-3ef1-4be5-868b-1966045013ce'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:54 devstack cinder-volume[87425]: WARNING cinder.db.api [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1349617335'] Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['40ae062b-87d1-4478-9afd-8851ee8c7c70', '7c5b69e6-cd70-4a97-974a-defa08121657', 'df4f6be5-f47f-4cd8-9951-83228edff6a1', '96bcb7f2-327a-4f68-a1d8-bbe1ac334906'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:54 devstack sudo[91223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:03:54 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:54 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72" returned: 0 in 3.794s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_btqgzfp4devstack@QuobyteHD, size 112.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:03:54 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Converted 112.00 MB image at 29.51 MB/s Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:54 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 1G Sep 01 02:03:54 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:54 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.476s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:54 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:54 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-518ea9c0-628a-43f7-8d9f-3e2ff6800765 tempest-GroupSnapshotsTest-637258634 None] Delete group completed successfully. Sep 01 02:03:55 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 1G" returned: 0 in 0.971s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Downloaded image 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume fa89f15b-e2c4-4688-8326-9100cf8bfd72 successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff for user 8f31bc2e5dc24b2fa69e7e85cf7f17ca is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Marking volume fa89f15b-e2c4-4688-8326-9100cf8bfd72 as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Copying metadata from image 694eb3d8-3f60-4f10-a358-172d9ec581ff to fa89f15b-e2c4-4688-8326-9100cf8bfd72. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Creating volume glance metadata for volume fa89f15b-e2c4-4688-8326-9100cf8bfd72 backed by image 694eb3d8-3f60-4f10-a358-172d9ec581ff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:03:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-f951411a-a0c4-4293-9c74-42808029b062 req-69e9a684-3693-4ed8-aa79-dc0976661039 tempest-ServerActionsTestOtherA-1855892746 None] Terminate volume connection completed successfully. Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-f951411a-a0c4-4293-9c74-42808029b062 req-69e9a684-3693-4ed8-aa79-dc0976661039 tempest-ServerActionsTestOtherA-1855892746 None] Deleting attachment 80ba1a4b-72a1-44ea-b68f-d95772cf2e4c. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0223e70f-eacb-4840-907d-3248c29bb23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecc0854-581f-45ce-9bf9-4ad0262575b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Volume volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 (fa89f15b-e2c4-4688-8326-9100cf8bfd72): created successfully Sep 01 02:03:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ecc0854-581f-45ce-9bf9-4ad0262575b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Flow 'volume_create_manager' (4f12de8c-b45a-4c5b-ba5b-c312b32910c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-990b0cd2-efcf-4e3f-acde-ed91b2904691 tempest-VolumesImageMetadata-1615090245 None] Created volume successfully. Sep 01 02:03:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-72f6d0a4-1551-407e-8236-d15342d7801b tempest-GroupSnapshotsTest-637258634 None] Group tempest-GroupSnapshotsTest-Group-174941872: creating Sep 01 02:03:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-72f6d0a4-1551-407e-8236-d15342d7801b tempest-GroupSnapshotsTest-637258634 None] Group tempest-GroupSnapshotsTest-Group-174941872: created successfully Sep 01 02:03:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-72f6d0a4-1551-407e-8236-d15342d7801b tempest-GroupSnapshotsTest-637258634 None] Create group completed successfully. Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Acquiring lock "cinder-fa89f15b-e2c4-4688-8326-9100cf8bfd72-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Lock "cinder-fa89f15b-e2c4-4688-8326-9100cf8bfd72-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Acquiring lock "cinder-quobyte-fa89f15b-e2c4-4688-8326-9100cf8bfd72" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Lock "cinder-quobyte-fa89f15b-e2c4-4688-8326-9100cf8bfd72" acquired by "delete_volume" :: waited 0.058s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-f951411a-a0c4-4293-9c74-42808029b062 req-d274e9a7-d6ca-461d-bd07-52785f16bf7d tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-f951411a-a0c4-4293-9c74-42808029b062 req-d274e9a7-d6ca-461d-bd07-52785f16bf7d tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd4c36a-938b-479f-b69e-d457ed3837da]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-f951411a-a0c4-4293-9c74-42808029b062 req-d274e9a7-d6ca-461d-bd07-52785f16bf7d tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.073s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-f951411a-a0c4-4293-9c74-42808029b062 req-d274e9a7-d6ca-461d-bd07-52785f16bf7d tempest-ServerActionsTestOtherA-1855892746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff3fb2eb-040b-4630-ab83-41feb4eff067', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:03:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-f951411a-a0c4-4293-9c74-42808029b062 req-d274e9a7-d6ca-461d-bd07-52785f16bf7d tempest-ServerActionsTestOtherA-1855892746 None] attachment_update completed successfully. Sep 01 02:03:57 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 Sep 01 02:03:58 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:58 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72" returned: 0 in 0.992s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:58 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72 Sep 01 02:03:58 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Flow 'volume_create_manager' (8d404881-be03-4f4a-82af-e9e6421e9dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae1845e-b6d3-48f7-ab1c-5991c6003f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ae1845e-b6d3-48f7-ab1c-5991c6003f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1548296416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef87a343-92af-4034-97e9-51d33f7201b1,host='devstack@QuobyteHD#QuobyteHD',id=d2e88510-5059-42b7-8502-8d5a3b21f5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40834eb1cc1943888ee121f521ffea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:59Z,use_quota=True,user_id='da7e39ddcd324f0b9119bed456b73692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d57ffc4c-3342-4189-85d8-3844c78d24d0),volume_type_id=d57ffc4c-3342-4189-85d8-3844c78d24d0)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760c3447-2bcf-42e8-b0e8-9bdcf54f53ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (760c3447-2bcf-42e8-b0e8-9bdcf54f53ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29434984-494d-4ea0-9957-ee3bf566d51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29434984-494d-4ea0-9957-ee3bf566d51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e88510-5059-42b7-8502-8d5a3b21f5e0', 'volume_name': 'volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443cc5e-bdc8-4163-ba14-3b515651f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6443cc5e-bdc8-4163-ba14-3b515651f693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f20b23-ce04-4118-837f-0d5a4979565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Volume d2e88510-5059-42b7-8502-8d5a3b21f5e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0', 'volume_size': 1} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef87a343-92af-4034-97e9-51d33f7201b1,created_at=2026-09-01T00:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1548296416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef87a343-92af-4034-97e9-51d33f7201b1,host='devstack@QuobyteHD#QuobyteHD',id=d2e88510-5059-42b7-8502-8d5a3b21f5e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40834eb1cc1943888ee121f521ffea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:59Z,use_quota=True,user_id='da7e39ddcd324f0b9119bed456b73692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d57ffc4c-3342-4189-85d8-3844c78d24d0),volume_type_id=d57ffc4c-3342-4189-85d8-3844c78d24d0)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Creating volume d2e88510-5059-42b7-8502-8d5a3b21f5e0 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:59 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:59 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fa89f15b-e2c4-4688-8326-9100cf8bfd72" returned: 0 in 0.719s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Lock "cinder-quobyte-fa89f15b-e2c4-4688-8326-9100cf8bfd72" released by "delete_volume" :: held 1.802s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:59 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 1073741824 Sep 01 02:03:59 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Created reservations ['e23f8779-73d2-4637-b8c1-2210a17c999a', '2555ba56-494f-4ad9-8ac7-59aea6144a4d', '713672c6-f3f6-4bee-83bd-a97f4bafb410', '3690298f-1aa3-4308-ad3f-1b67ebe94913'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:59 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:03:59 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:00 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.519s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:00 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Deleted volume successfully. Sep 01 02:04:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-18feaf37-6a5a-4574-9889-2743b5ef67fc tempest-VolumesImageMetadata-1615090245 None] Lock "cinder-fa89f15b-e2c4-4688-8326-9100cf8bfd72-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:00 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 1073741824" returned: 0 in 1.077s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:00 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 Sep 01 02:04:00 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:01 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0" returned: 0 in 0.785s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f20b23-ce04-4118-837f-0d5a4979565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c3dcd0-1566-42a3-9ca1-fc02d17af6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:01 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Volume volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 (d2e88510-5059-42b7-8502-8d5a3b21f5e0): created successfully Sep 01 02:04:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c3dcd0-1566-42a3-9ca1-fc02d17af6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Flow 'volume_create_manager' (8d404881-be03-4f4a-82af-e9e6421e9dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:01 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a235021b-a999-4d02-a2e4-0152567dac56 tempest-GroupSnapshotsTest-637258634 None] Created volume successfully. Sep 01 02:04:03 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Flow 'volume_create_manager' (0c908a46-0d36-48d7-9dcf-a4d30f8fdd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea1bb25-03f8-4384-8a15-ed928259e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea1bb25-03f8-4384-8a15-ed928259e80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-359059205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef87a343-92af-4034-97e9-51d33f7201b1,host='devstack@QuobyteHD#QuobyteHD',id=b19590ff-2ff6-4ca7-b955-51ef9466763d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40834eb1cc1943888ee121f521ffea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:03Z,use_quota=True,user_id='da7e39ddcd324f0b9119bed456b73692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d57ffc4c-3342-4189-85d8-3844c78d24d0),volume_type_id=d57ffc4c-3342-4189-85d8-3844c78d24d0)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db6f7b3-7787-4b31-bf45-e789c9186d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db6f7b3-7787-4b31-bf45-e789c9186d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a7a556-ed1f-4b39-8e69-1a4d4a4d5fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a7a556-ed1f-4b39-8e69-1a4d4a4d5fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19590ff-2ff6-4ca7-b955-51ef9466763d', 'volume_name': 'volume-b19590ff-2ff6-4ca7-b955-51ef9466763d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a078160-6f79-4a7e-b529-7aca7619c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a078160-6f79-4a7e-b529-7aca7619c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc7f905-b990-4cb2-89cd-591178f72da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:04 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Volume b19590ff-2ff6-4ca7-b955-51ef9466763d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19590ff-2ff6-4ca7-b955-51ef9466763d', 'volume_size': 1} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef87a343-92af-4034-97e9-51d33f7201b1,created_at=2026-09-01T00:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-359059205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef87a343-92af-4034-97e9-51d33f7201b1,host='devstack@QuobyteHD#QuobyteHD',id=b19590ff-2ff6-4ca7-b955-51ef9466763d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40834eb1cc1943888ee121f521ffea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:03Z,use_quota=True,user_id='da7e39ddcd324f0b9119bed456b73692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d57ffc4c-3342-4189-85d8-3844c78d24d0),volume_type_id=d57ffc4c-3342-4189-85d8-3844c78d24d0)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Creating volume b19590ff-2ff6-4ca7-b955-51ef9466763d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:04 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:04 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d 1073741824 Sep 01 02:04:04 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:05 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d 1073741824" returned: 0 in 1.447s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:05 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d Sep 01 02:04:05 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:05 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d" returned: 0 in 0.325s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccc7f905-b990-4cb2-89cd-591178f72da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19590ff-2ff6-4ca7-b955-51ef9466763d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34817c9a-d782-459c-9a0a-fc20eda4ca6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:05 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Volume volume-b19590ff-2ff6-4ca7-b955-51ef9466763d (b19590ff-2ff6-4ca7-b955-51ef9466763d): created successfully Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34817c9a-d782-459c-9a0a-fc20eda4ca6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Flow 'volume_create_manager' (0c908a46-0d36-48d7-9dcf-a4d30f8fdd5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d557e3b0-7b50-4aba-8057-883b02510c65 tempest-GroupSnapshotsTest-637258634 None] Created volume successfully. Sep 01 02:04:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:06 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:06 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:07 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.740s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:07 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:07 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:04:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:04:07 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b20b4433-2ee3-40f8-8f33-097120c617c0 tempest-GroupSnapshotsTest-637258634 None] Update group completed successfully. Sep 01 02:04:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-df503e27-8bc0-43f0-bddb-464ded119743 tempest-GroupSnapshotsTest-637258634 None] Update group completed successfully. Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Flow 'volume_create_manager' (4c46253f-beec-41cc-99ce-e23cc3bfb8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9788079-513c-43b9-b98e-4503e91184f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9788079-513c-43b9-b98e-4503e91184f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2135015761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073bb74d22b14da6afdc9b1988d802b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:09Z,use_quota=True,user_id='7ac2cb3e5e104270b731c3a394536aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536318a2-ab0a-41e7-80a2-7d786da2579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536318a2-ab0a-41e7-80a2-7d786da2579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8417b290-93d2-4117-82ff-6c49316cb0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8417b290-93d2-4117-82ff-6c49316cb0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af', 'volume_name': 'volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813a787a-2ff0-4eb3-99cc-2131c78292aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813a787a-2ff0-4eb3-99cc-2131c78292aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68f5457-65b7-41ec-8c2c-978a5e3f185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Volume 947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af', 'volume_size': 1} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2135015761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073bb74d22b14da6afdc9b1988d802b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:09Z,use_quota=True,user_id='7ac2cb3e5e104270b731c3a394536aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Creating volume 947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:09 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:09 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af 1073741824 Sep 01 02:04:09 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-68dabb1a-52ac-44b2-a084-735f57c9d560 tempest-GroupSnapshotsTest-637258634 None] Update group completed successfully. Sep 01 02:04:10 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af 1073741824" returned: 0 in 0.776s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:10 devstack sudo[91896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af Sep 01 02:04:10 devstack sudo[91896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:10 devstack sudo[91896]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" returned: 0 in 0.439s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68f5457-65b7-41ec-8c2c-978a5e3f185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ed9027-a6b5-4103-bc6a-a1ffd3c8eae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:10 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Volume volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af (947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af): created successfully Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57ed9027-a6b5-4103-bc6a-a1ffd3c8eae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Flow 'volume_create_manager' (4c46253f-beec-41cc-99ce-e23cc3bfb8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7cf45021-3ba6-403e-a477-99fc463a22e3 tempest-SnapshotMetadataTestJSON-574701887 None] Created volume successfully. Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Creating offline snapshot 74baed85-0db8-4f2a-8e24-bd7e80fec53a of volume 947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ea2b06-9c94-4ab5-b12c-567429f2b717]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-54257059-4474-4850-84c8-fbe44727a8ce tempest-GroupSnapshotsTest-637258634 None] Update group completed successfully. Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Flow 'volume_create_manager' (c22a4c51-7747-4960-92a9-3dbf7a24c471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e67c39a-fa4b-496f-ad18-ca1e09e33e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af Sep 01 02:04:11 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e67c39a-fa4b-496f-ad18-ca1e09e33e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-435943815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3638934ba6754677aeb10e1ba8b44ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:12Z,use_quota=True,user_id='eff35486ee534bda8c55698836ba04a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26601f6e-6a12-4930-8a9c-38d7b4716dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26601f6e-6a12-4930-8a9c-38d7b4716dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb77b79-bd90-4a3c-b03c-39757fc34b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb77b79-bd90-4a3c-b03c-39757fc34b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe', 'volume_name': 'volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4a699f-e8db-4d77-a117-24e70aff1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4a699f-e8db-4d77-a117-24e70aff1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700409de-ee00-4733-bce6-14b5fb2700f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:11 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Volume b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe', 'volume_size': 1} Sep 01 02:04:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:12 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:12 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a 1G Sep 01 02:04:12 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:12 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a 1G" returned: 0 in 0.455s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:12 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a Sep 01 02:04:12 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:12 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a" returned: 0 in 0.387s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:12 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a is being set with open permissions: ugo+rw Sep 01 02:04:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:12 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a Sep 01 02:04:12 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:13 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a" returned: 0 in 0.294s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:13 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.info Sep 01 02:04:13 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] GroupSnapshot 9a1e352e-4f42-4946-92b5-5360b0b92151: creating. Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Group snapshot 9a1e352e-4f42-4946-92b5-5360b0b92151: creating. {{(pid=87425) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:13 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.info" returned: 0 in 0.354s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:13 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.info is being set with open permissions: ugo+rw Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:13 devstack sudo[91923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.info Sep 01 02:04:13 devstack sudo[91923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:13 devstack sudo[91923]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.info" returned: 0 in 0.308s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-435943815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3638934ba6754677aeb10e1ba8b44ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:12Z,use_quota=True,user_id='eff35486ee534bda8c55698836ba04a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Creating volume b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:14 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:14 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe 1073741824 Sep 01 02:04:14 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7b595301-b293-4d7d-897f-a18a0ec09909 tempest-SnapshotMetadataTestJSON-574701887 None] Create snapshot completed successfully Sep 01 02:04:14 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe 1073741824" returned: 0 in 0.502s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:14 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe Sep 01 02:04:14 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:14 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe" returned: 0 in 0.334s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.516s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700409de-ee00-4733-bce6-14b5fb2700f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f56d792-6e7e-4d21-8f8f-9b0ce5c6d671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Creating offline snapshot 9017e4ea-605a-484f-9597-007bc4072a89 of volume d2e88510-5059-42b7-8502-8d5a3b21f5e0 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:14 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Volume volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe (b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe): created successfully Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f56d792-6e7e-4d21-8f8f-9b0ce5c6d671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Flow 'volume_create_manager' (c22a4c51-7747-4960-92a9-3dbf7a24c471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eda76eb-4859-4bd7-b515-269f9fc1d8b6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e131f978-bafc-41ff-a893-05c8cac8fbf1 tempest-ServersNegativeTestJSON-139658675 None] Created volume successfully. Sep 01 02:04:15 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 Sep 01 02:04:15 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:15 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:15 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 1G Sep 01 02:04:15 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "cinder-74baed85-0db8-4f2a-8e24-bd7e80fec53a-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-74baed85-0db8-4f2a-8e24-bd7e80fec53a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "cinder-quobyte-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-quobyte-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "cinder-quobyte-74baed85-0db8-4f2a-8e24-bd7e80fec53a" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-quobyte-74baed85-0db8-4f2a-8e24-bd7e80fec53a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Deleting offline snapshot 74baed85-0db8-4f2a-8e24-bd7e80fec53a of volume 947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] snapshot_file for this snap is: volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e28b35-ea38-4ec5-983f-a300b1343a84]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:15 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a Sep 01 02:04:15 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:16 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 1G" returned: 0 in 0.605s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:16 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 Sep 01 02:04:16 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:16 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac85371-a1bb-4f17-ae82-5c801a5dc1d0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:16 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af Sep 01 02:04:16 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:16 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89" returned: 0 in 0.589s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:16 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:16 devstack sudo[91960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 Sep 01 02:04:16 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:16 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" returned: 0 in 0.667s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:16 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a Sep 01 02:04:16 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:17 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89" returned: 0 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:17 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.info Sep 01 02:04:17 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:17 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a" returned: 0 in 0.474s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:17 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a Sep 01 02:04:17 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:17 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.info" returned: 0 in 0.346s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:17 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:17 devstack sudo[91976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.info Sep 01 02:04:17 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:17 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af.74baed85-0db8-4f2a-8e24-bd7e80fec53a" returned: 0 in 0.392s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-quobyte-74baed85-0db8-4f2a-8e24-bd7e80fec53a" released by "_delete_snapshot" :: held 2.191s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-quobyte-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" released by "delete_snapshot" :: held 2.229s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:17 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.info" returned: 0 in 0.375s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.939s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Creating offline snapshot bfe06055-7216-461c-b9bf-f06bb82e762d of volume b19590ff-2ff6-4ca7-b955-51ef9466763d {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[da77ab49-94a9-4fef-b3ae-bab1a8558a24]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:17 devstack cinder-volume[87425]: WARNING cinder.quota [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Created reservations ['a8064c03-4750-4802-a8bf-10cda280e89e', '17d04596-c454-4df0-88c2-f35b495fd25e', '5d067fb3-d462-454c-abf4-8274a1bb5158', '8ef45c2e-5d32-4c6d-9f33-5cf6598df2a8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:18 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Delete snapshot completed successfully. Sep 01 02:04:18 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d Sep 01 02:04:18 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-34369831-2288-457d-adf0-760657168474 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-74baed85-0db8-4f2a-8e24-bd7e80fec53a-delete_snapshot" released by "delete_snapshot" :: held 2.613s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Flow 'volume_create_manager' (177e288b-39e6-4a63-bf0b-08a9d9ff6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40ab04d-0ed5-4446-9d92-e61a7a0316d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40ab04d-0ed5-4446-9d92-e61a7a0316d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2066367609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a35817-163d-4364-b202-b885d582719f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3638934ba6754677aeb10e1ba8b44ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:18Z,use_quota=True,user_id='eff35486ee534bda8c55698836ba04a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5426aae-19da-4a03-adf1-4037b457df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5426aae-19da-4a03-adf1-4037b457df5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2ea2c2-4890-44eb-a137-93b229c31cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2ea2c2-4890-44eb-a137-93b229c31cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a35817-163d-4364-b202-b885d582719f', 'volume_name': 'volume-c0a35817-163d-4364-b202-b885d582719f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b909a0-9a79-487b-9610-972801d66012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b909a0-9a79-487b-9610-972801d66012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a742b472-076e-4ed1-9a2e-f354fd11c000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:18 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Volume c0a35817-163d-4364-b202-b885d582719f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a35817-163d-4364-b202-b885d582719f', 'volume_size': 1} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:18 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d" returned: 0 in 0.593s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:18 devstack sudo[92007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d 1G Sep 01 02:04:18 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "cinder-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "cinder-quobyte-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-quobyte-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:19 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d 1G" returned: 0 in 0.613s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19590ff-2ff6-4ca7-b955-51ef9466763d -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[087e6514-b19c-4360-9edc-6e47902f038c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:19 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19590ff-2ff6-4ca7-b955-51ef9466763d -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d Sep 01 02:04:19 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:19 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af Sep 01 02:04:19 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:19 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19590ff-2ff6-4ca7-b955-51ef9466763d -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d" returned: 0 in 0.333s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:19 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:19 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d Sep 01 02:04:19 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:19 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" returned: 0 in 0.425s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:19 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af Sep 01 02:04:19 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:19 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d" returned: 0 in 0.301s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:19 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.info Sep 01 02:04:19 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:19 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" returned: 0 in 0.292s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-quobyte-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af" released by "delete_volume" :: held 0.811s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:19 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Created reservations ['f5f1a76b-4827-48e7-959b-2ccc1caa8fc0', '78c6c8e2-3935-4d15-a88c-502e901b1a4b', '611a6f50-b681-41d3-b05b-9a897c5b1fb7', '1d3a32f7-2064-4a83-96f6-7eabde360fca'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[92033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:20 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.info" returned: 0 in 0.317s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.info Sep 01 02:04:20 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.315s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Deleted volume successfully. Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9fff56ae-80c0-472c-9e1e-510a31997b13 tempest-SnapshotMetadataTestJSON-574701887 None] Lock "cinder-947ef2b5-ffec-4a5e-a70c-cd4dad0ca0af-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:20 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.info" returned: 0 in 0.349s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2066367609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a35817-163d-4364-b202-b885d582719f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3638934ba6754677aeb10e1ba8b44ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:18Z,use_quota=True,user_id='eff35486ee534bda8c55698836ba04a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Creating volume c0a35817-163d-4364-b202-b885d582719f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:20 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:20 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f 1073741824 Sep 01 02:04:20 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-544b2b1b-2b0e-41f9-8486-5c3973742f0d tempest-GroupSnapshotsTest-637258634 None] group_snapshot 9a1e352e-4f42-4946-92b5-5360b0b92151: created successfully Sep 01 02:04:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] group_snapshot 9a1e352e-4f42-4946-92b5-5360b0b92151: deleting Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=98,cinder:SELECT=115,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=99,cinder:SELECT=115,cinder:INSERT=26,cinder:DELETE=3 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] group_snapshot 9a1e352e-4f42-4946-92b5-5360b0b92151: deleting {{(pid=87425) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-d2e88510-5059-42b7-8502-8d5a3b21f5e0" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-d2e88510-5059-42b7-8502-8d5a3b21f5e0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-9017e4ea-605a-484f-9597-007bc4072a89" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-9017e4ea-605a-484f-9597-007bc4072a89" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Deleting offline snapshot 9017e4ea-605a-484f-9597-007bc4072a89 of volume d2e88510-5059-42b7-8502-8d5a3b21f5e0 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] snapshot_file for this snap is: volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:21 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f 1073741824" returned: 0 in 0.689s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c859d0-709f-42b1-93ab-c010ac3cbd6f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:21 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f Sep 01 02:04:21 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:21 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 Sep 01 02:04:21 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:21 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f" returned: 0 in 0.323s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a742b472-076e-4ed1-9a2e-f354fd11c000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a35817-163d-4364-b202-b885d582719f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add685bd-e6d2-48f8-a90f-edf4f387597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:21 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Volume volume-c0a35817-163d-4364-b202-b885d582719f (c0a35817-163d-4364-b202-b885d582719f): created successfully Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add685bd-e6d2-48f8-a90f-edf4f387597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Flow 'volume_create_manager' (177e288b-39e6-4a63-bf0b-08a9d9ff6965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-dad76b96-dd30-4d10-8811-ea66875f6de1 tempest-ServersNegativeTestJSON-139658675 None] Created volume successfully. Sep 01 02:04:21 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89" returned: 0 in 0.549s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4302f634-f790-4d6a-8156-1e8ff5167d91]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:21 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 Sep 01 02:04:21 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:22 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0" returned: 0 in 0.432s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:22 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 Sep 01 02:04:22 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:22 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89" returned: 0 in 0.461s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:22 devstack sudo[92087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89 Sep 01 02:04:22 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:23 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0.9017e4ea-605a-484f-9597-007bc4072a89" returned: 0 in 0.315s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "cinder-c0a35817-163d-4364-b202-b885d582719f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-9017e4ea-605a-484f-9597-007bc4072a89" released by "_delete_snapshot" :: held 1.945s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Lock "cinder-c0a35817-163d-4364-b202-b885d582719f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-d2e88510-5059-42b7-8502-8d5a3b21f5e0" released by "delete_snapshot" :: held 1.994s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-b19590ff-2ff6-4ca7-b955-51ef9466763d" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-b19590ff-2ff6-4ca7-b955-51ef9466763d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-bfe06055-7216-461c-b9bf-f06bb82e762d" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "cinder-quobyte-c0a35817-163d-4364-b202-b885d582719f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-bfe06055-7216-461c-b9bf-f06bb82e762d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Deleting offline snapshot bfe06055-7216-461c-b9bf-f06bb82e762d of volume b19590ff-2ff6-4ca7-b955-51ef9466763d {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] snapshot_file for this snap is: volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Lock "cinder-quobyte-c0a35817-163d-4364-b202-b885d582719f" acquired by "delete_volume" :: waited 0.045s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6411d4-a50a-4cc3-b8e8-386a19ac5fc8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f95daec-8335-4553-aa07-0f0923aa40b7]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:23 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d Sep 01 02:04:23 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:23 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f Sep 01 02:04:23 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:23 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d" returned: 0 in 0.457s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b19590ff-2ff6-4ca7-b955-51ef9466763d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:23 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f" returned: 0 in 0.467s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a07b20a-3024-4ef5-bd74-cabc52a730d8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:23 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f Sep 01 02:04:23 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:23 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d Sep 01 02:04:23 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:24 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c0a35817-163d-4364-b202-b885d582719f" returned: 0 in 0.316s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Lock "cinder-quobyte-c0a35817-163d-4364-b202-b885d582719f" released by "delete_volume" :: held 0.839s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Created reservations ['386619c2-9fde-472b-98b6-007cc6cf34ef', '09c58c7e-0979-426b-b9b5-9fc41b4686c7', 'daff1f29-52db-4296-aac6-2b5287c87884', '4b160e62-40da-40cf-aaa8-c9bf44183089'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:24 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d" returned: 0 in 0.505s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:24 devstack sudo[92109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:24 devstack sudo[92109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:24 devstack sudo[92110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d Sep 01 02:04:24 devstack sudo[92110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "cinder-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Lock "cinder-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "cinder-quobyte-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Lock "cinder-quobyte-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d63d64-1ae3-49d9-8553-da077c55bb1a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:24 devstack sudo[92109]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.349s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Deleted volume successfully. Sep 01 02:04:24 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe Sep 01 02:04:24 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c2ce7740-6692-4a04-8ce1-bdafad822772 tempest-ServersNegativeTestJSON-139658675 None] Lock "cinder-c0a35817-163d-4364-b202-b885d582719f-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:24 devstack sudo[92110]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d" returned: 0 in 0.559s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:24 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d Sep 01 02:04:24 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:24 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe" returned: 0 in 0.449s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:24 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe Sep 01 02:04:24 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:25 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d.bfe06055-7216-461c-b9bf-f06bb82e762d" returned: 0 in 0.310s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-bfe06055-7216-461c-b9bf-f06bb82e762d" released by "_delete_snapshot" :: held 1.980s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-b19590ff-2ff6-4ca7-b955-51ef9466763d" released by "delete_snapshot" :: held 2.010s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:25 devstack cinder-volume[87425]: WARNING cinder.quota [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1842872213 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1842872213, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:25 devstack cinder-volume[87425]: WARNING cinder.quota [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1842872213 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1842872213, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:25 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['4465012d-4db7-4a6b-bbc4-67cf3d2de4c8', 'a5307809-e8f7-4bad-9f9b-3d2cba5d22f5', '93efec2b-f882-4a7b-bd9f-2e1a5e4356ce', '5b2b38fa-a22f-4a1f-9343-b79bb1f3e925'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe" returned: 0 in 0.445s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Lock "cinder-quobyte-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe" released by "delete_volume" :: held 0.973s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Flow 'volume_create_manager' (f876b902-91d7-4516-8c9a-a80c3cdc57de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51041f51-661e-4fcc-9250-127a7b8e4955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51041f51-661e-4fcc-9250-127a7b8e4955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2002220621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992418ac-f8c6-4f56-930a-f14fdeb0c276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ee3c151ca946b88b481a488247e150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:25Z,use_quota=True,user_id='5e63418e5c514a3d84527ae066d19f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33f3ff1-8a42-47f2-8351-3ebe2e5e11d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33f3ff1-8a42-47f2-8351-3ebe2e5e11d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c2321f-53dd-42ca-af35-c5f200eff661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c2321f-53dd-42ca-af35-c5f200eff661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992418ac-f8c6-4f56-930a-f14fdeb0c276', 'volume_name': 'volume-992418ac-f8c6-4f56-930a-f14fdeb0c276', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5808adb-c89d-4f39-a449-727ed28ef47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5808adb-c89d-4f39-a449-727ed28ef47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1bb268-7c3d-43ae-bfbf-5a2b1bafddd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:25 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Volume 992418ac-f8c6-4f56-930a-f14fdeb0c276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992418ac-f8c6-4f56-930a-f14fdeb0c276', 'volume_size': 1} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2002220621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992418ac-f8c6-4f56-930a-f14fdeb0c276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ee3c151ca946b88b481a488247e150',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:25Z,use_quota=True,user_id='5e63418e5c514a3d84527ae066d19f0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Creating volume 992418ac-f8c6-4f56-930a-f14fdeb0c276 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:25 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Created reservations ['1a225359-462c-4c08-9fcd-54e2a85e352e', '5e3e2571-7eb4-414f-a527-a5f8ab70bb0f', 'ae63a3aa-5265-48fb-b249-f2fe25c6f803', '95fa844a-4e4c-423a-b186-f09185fece39'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:25 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 1073741824 Sep 01 02:04:25 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['cf94953e-c116-4dac-927a-84161a31b03c', '8280b202-790c-4a17-a599-d44182298843', '8a3574ed-9789-46d0-b33c-cbd72f68af0b', '1d3f3495-5436-4258-b245-2aca0abb2602'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:25 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:25 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7236b75a-b173-45aa-99fd-92cefc6c0b74 tempest-GroupSnapshotsTest-637258634 None] group_snapshot 9a1e352e-4f42-4946-92b5-5360b0b92151: deleted successfully Sep 01 02:04:26 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.364s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Deleted volume successfully. Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-92c1f799-4d1f-44a1-9146-531edd0ece8f tempest-ServersNegativeTestJSON-139658675 None] Lock "cinder-b2d5ebd3-9f8d-4ce0-ba38-6c91a03d97fe-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:26 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 1073741824" returned: 0 in 0.636s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:26 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 Sep 01 02:04:26 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:26 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276" returned: 0 in 0.302s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1bb268-7c3d-43ae-bfbf-5a2b1bafddd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992418ac-f8c6-4f56-930a-f14fdeb0c276', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a6ce8c-5b1c-4d9b-a9f9-cdf0bd10c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:26 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Volume volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 (992418ac-f8c6-4f56-930a-f14fdeb0c276): created successfully Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a6ce8c-5b1c-4d9b-a9f9-cdf0bd10c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Flow 'volume_create_manager' (f876b902-91d7-4516-8c9a-a80c3cdc57de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e0f34a19-4e01-414e-829b-b6d50d88f809 tempest-AbsoluteLimitsTests-676148975 None] Created volume successfully. Sep 01 02:04:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-b19590ff-2ff6-4ca7-b955-51ef9466763d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-b19590ff-2ff6-4ca7-b955-51ef9466763d" acquired by "delete_volume" :: waited 0.034s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:27 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a9a634-0d58-45b5-ae18-9966afb2447b]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:28 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d Sep 01 02:04:28 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Acquiring lock "cinder-992418ac-f8c6-4f56-930a-f14fdeb0c276-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Lock "cinder-992418ac-f8c6-4f56-930a-f14fdeb0c276-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Acquiring lock "cinder-quobyte-992418ac-f8c6-4f56-930a-f14fdeb0c276" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Lock "cinder-quobyte-992418ac-f8c6-4f56-930a-f14fdeb0c276" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e5fd8-a729-4877-8790-ecc8921a4d96]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:28 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d" returned: 0 in 0.658s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:28 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 Sep 01 02:04:28 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:28 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d Sep 01 02:04:28 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:28 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b19590ff-2ff6-4ca7-b955-51ef9466763d" returned: 0 in 0.353s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:28 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276" returned: 0 in 0.616s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-b19590ff-2ff6-4ca7-b955-51ef9466763d" released by "delete_volume" :: held 1.177s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-d2e88510-5059-42b7-8502-8d5a3b21f5e0" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:28 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276 Sep 01 02:04:28 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-d2e88510-5059-42b7-8502-8d5a3b21f5e0" acquired by "delete_volume" :: waited 0.057s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4df646-a5eb-43fc-9618-5957cd4b4c94]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:29 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 Sep 01 02:04:29 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:29 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-992418ac-f8c6-4f56-930a-f14fdeb0c276" returned: 0 in 0.428s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Lock "cinder-quobyte-992418ac-f8c6-4f56-930a-f14fdeb0c276" released by "delete_volume" :: held 1.118s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Created reservations ['c5c2bad6-5f8d-4bef-a9ba-b6ecf6ddaaee', '90fc6b2f-948e-4469-95fe-f0eb71ed6f93', '5d195562-e3c4-434f-856c-d760a77d8b96', '39616ceb-04db-4802-9986-1b7b332ac8b7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:29 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:29 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:29 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0" returned: 0 in 0.599s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:29 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0 Sep 01 02:04:29 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:29 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.359s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Deleted volume successfully. Sep 01 02:04:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73550934-759a-4eb8-9995-a49d57c1dfae tempest-AbsoluteLimitsTests-676148975 None] Lock "cinder-992418ac-f8c6-4f56-930a-f14fdeb0c276-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:30 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2e88510-5059-42b7-8502-8d5a3b21f5e0" returned: 0 in 0.486s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-d2e88510-5059-42b7-8502-8d5a3b21f5e0" released by "delete_volume" :: held 1.213s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['94e573ec-e4d0-4d1b-9d1b-741285a2fac8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:30 devstack cinder-volume[87425]: WARNING cinder.quota [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1842872213 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1842872213, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['cab35bba-27a1-449b-bcfd-a35a1753e3d6', '4d0aabe0-b3c9-4c59-8250-4f6b6141c9b6', '6cd330ab-cfff-48b1-a1a3-f7e96427fa7e', '120e1f4c-e0f6-4ca1-b9e5-fc21e529997b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['1995ac8b-0941-41e4-9230-aa0ba3f27d4f', '3a46b4a4-4d7d-423d-9b73-c1c7b7523bf8', '3d833a88-d53e-4b39-9c40-8849b1c01517', '894d6996-3dd2-4bc1-8520-f0fbbc4e15b3'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:30 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:30 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-13bff38a-2ab5-47de-9704-a4f6369e4fd9 req-8a6376b6-069b-47e6-9a49-35a495ec3c81 tempest-ServerActionsTestOtherA-1855892746 None] Terminate volume connection completed successfully. Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-13bff38a-2ab5-47de-9704-a4f6369e4fd9 req-8a6376b6-069b-47e6-9a49-35a495ec3c81 tempest-ServerActionsTestOtherA-1855892746 None] Deleting attachment ff3fb2eb-040b-4630-ab83-41feb4eff067. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:04:30 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.335s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:30 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-493c805c-950a-40f5-af8b-171e68844858 tempest-GroupSnapshotsTest-637258634 None] Delete group completed successfully. Sep 01 02:04:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-be4899a9-10af-4652-b767-7b9645f159d8 tempest-GroupSnapshotsTest-637258634 None] Group tempest-GroupSnapshotsTest-Group-106528708: creating Sep 01 02:04:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-be4899a9-10af-4652-b767-7b9645f159d8 tempest-GroupSnapshotsTest-637258634 None] Group tempest-GroupSnapshotsTest-Group-106528708: created successfully Sep 01 02:04:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-be4899a9-10af-4652-b767-7b9645f159d8 tempest-GroupSnapshotsTest-637258634 None] Create group completed successfully. Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Flow 'volume_create_manager' (88f63fa5-39bc-4964-bcfe-a8d9a97fa318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42d929b-d6aa-4fa3-a14f-4bf0397cfc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42d929b-d6aa-4fa3-a14f-4bf0397cfc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886923659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=430ec0e9-519d-47b9-9c5a-a02fa53791ea,host='devstack@QuobyteHD#QuobyteHD',id=44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40834eb1cc1943888ee121f521ffea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:34Z,use_quota=True,user_id='da7e39ddcd324f0b9119bed456b73692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(390c3b33-2fd0-42ab-95e0-53cde5f51214),volume_type_id=390c3b33-2fd0-42ab-95e0-53cde5f51214)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a1686c-d0b5-4353-913c-e0ddc4be6666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a1686c-d0b5-4353-913c-e0ddc4be6666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae504eec-a3ec-43bd-b7c7-4a6e3e4e40fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae504eec-a3ec-43bd-b7c7-4a6e3e4e40fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e', 'volume_name': 'volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231ed158-2057-49e5-ac35-e13a15c210fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231ed158-2057-49e5-ac35-e13a15c210fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd87824c-d0d1-40a8-b5cc-b49237d6cd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:34 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Volume 44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e', 'volume_size': 1} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=430ec0e9-519d-47b9-9c5a-a02fa53791ea,created_at=2026-09-01T00:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886923659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=430ec0e9-519d-47b9-9c5a-a02fa53791ea,host='devstack@QuobyteHD#QuobyteHD',id=44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40834eb1cc1943888ee121f521ffea73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:34Z,use_quota=True,user_id='da7e39ddcd324f0b9119bed456b73692',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(390c3b33-2fd0-42ab-95e0-53cde5f51214),volume_type_id=390c3b33-2fd0-42ab-95e0-53cde5f51214)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Creating volume 44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:34 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:34 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e 1073741824 Sep 01 02:04:34 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:35 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e 1073741824" returned: 0 in 0.696s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:35 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e Sep 01 02:04:35 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:35 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" returned: 0 in 0.414s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd87824c-d0d1-40a8-b5cc-b49237d6cd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbf1684-f83e-423c-99dc-4e47d8044802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:35 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Volume volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e (44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e): created successfully Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbf1684-f83e-423c-99dc-4e47d8044802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Flow 'volume_create_manager' (88f63fa5-39bc-4964-bcfe-a8d9a97fa318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-664640c7-498d-4fa8-a7e3-ea12fc02ef7e tempest-GroupSnapshotsTest-637258634 None] Created volume successfully. Sep 01 02:04:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] GroupSnapshot 9cf8a71b-db46-427c-b0e6-8bb15972f832: creating. Sep 01 02:04:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Group snapshot 9cf8a71b-db46-427c-b0e6-8bb15972f832: creating. {{(pid=87425) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:04:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Creating offline snapshot cc5a7b99-46f9-4306-8092-f86c875cb331 of volume 44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:37 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d75f4de-988b-4ea6-9b76-d2768c61c542]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:37 devstack sudo[92281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e Sep 01 02:04:37 devstack sudo[92281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:38 devstack sudo[92281]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:38 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 1G Sep 01 02:04:38 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:38 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 1G" returned: 0 in 0.672s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:38 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 Sep 01 02:04:38 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:39 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331" returned: 0 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:39 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:39 devstack sudo[92299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 Sep 01 02:04:39 devstack sudo[92299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:39 devstack sudo[92299]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331" returned: 0 in 0.313s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:39 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.info Sep 01 02:04:39 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:39 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Flow 'volume_create_manager' (b42d9862-fffb-4e21-b2d8-81de5c6dd6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91742216-903a-42df-b266-f1cdabff321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.info" returned: 0 in 0.491s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:39 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91742216-903a-42df-b266-f1cdabff321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1050753494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b20aaea-3996-4d56-8ed0-8c74620ba15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175665b91a9642c6a7c0cd25c5fad375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:40Z,use_quota=True,user_id='1334440cfd684d8288d24ee265771d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:39 devstack sudo[92306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.info Sep 01 02:04:39 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921fec2d-23d6-40c9-bfa7-0538203e7c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921fec2d-23d6-40c9-bfa7-0538203e7c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64dabf2d-73f2-4437-ac52-83257e352913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:04:40 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.info" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.841s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:40 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f6a868f7-602f-4154-80d3-b6ccb7be678a tempest-GroupSnapshotsTest-637258634 None] group_snapshot 9cf8a71b-db46-427c-b0e6-8bb15972f832: created successfully Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64dabf2d-73f2-4437-ac52-83257e352913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b20aaea-3996-4d56-8ed0-8c74620ba15d', 'volume_name': 'volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26641c5d-a884-46b5-94c2-a60377c23a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26641c5d-a884-46b5-94c2-a60377c23a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d417fb-1af9-41f4-a480-327001d5806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:40 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Volume 2b20aaea-3996-4d56-8ed0-8c74620ba15d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Trying to clone 2b20aaea-3996-4d56-8ed0-8c74620ba15d from image 694eb3d8-3f60-4f10-a358-172d9ec581ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:04:40 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] group_snapshot 9cf8a71b-db46-427c-b0e6-8bb15972f832: deleting Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] group_snapshot 9cf8a71b-db46-427c-b0e6-8bb15972f832: deleting {{(pid=87425) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-cc5a7b99-46f9-4306-8092-f86c875cb331" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-cc5a7b99-46f9-4306-8092-f86c875cb331" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Deleting offline snapshot cc5a7b99-46f9-4306-8092-f86c875cb331 of volume 44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] snapshot_file for this snap is: volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9159e13-bee1-4ae0-b55d-ecc7b7f5af46]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack sudo[92309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 Sep 01 02:04:41 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:04:41 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0a7e34-d018-4df1-9ebd-2e2b46c00ead]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Flow 'volume_create_manager' (f0f06736-36a6-4112-a039-ea2d6adaaf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16932e00-aed0-4f14-aa82-6dfd9416b9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16932e00-aed0-4f14-aa82-6dfd9416b9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1107989578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19de937b-0759-4b39-9387-27e71850b4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4416ac84820f49c0af13b2b0ceb72bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:41Z,use_quota=True,user_id='56a45369bb88421198d426fd1c87ec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a8977a-aa95-464a-a7a8-e9b76132ac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a8977a-aa95-464a-a7a8-e9b76132ac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f17fd2-c3d5-4d78-9719-8190ec29753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f17fd2-c3d5-4d78-9719-8190ec29753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19de937b-0759-4b39-9387-27e71850b4a2', 'volume_name': 'volume-19de937b-0759-4b39-9387-27e71850b4a2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb51d93-7d4c-426c-9bb5-d787a754ebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb51d93-7d4c-426c-9bb5-d787a754ebee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6957eab7-c0ee-4e47-a3dc-2baf197de2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Volume 19de937b-0759-4b39-9387-27e71850b4a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19de937b-0759-4b39-9387-27e71850b4a2', 'volume_size': 1} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1107989578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19de937b-0759-4b39-9387-27e71850b4a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4416ac84820f49c0af13b2b0ceb72bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:41Z,use_quota=True,user_id='56a45369bb88421198d426fd1c87ec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Creating volume 19de937b-0759-4b39-9387-27e71850b4a2 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:41 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331" returned: 0 in 0.617s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:41 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 1073741824 Sep 01 02:04:41 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[33078445-9ae8-417b-a4df-f5fca1cb08dc]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:41 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff is fetched for user 1334440cfd684d8288d24ee265771d89. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:04:41 devstack sudo[92319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e Sep 01 02:04:41 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c58590-02be-4751-bfc3-a7418f9a97b5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[92329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD Sep 01 02:04:42 devstack sudo[92329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" returned: 0 in 0.637s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 Sep 01 02:04:42 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 1073741824" returned: 0 in 0.842s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[92329]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD" returned: 0 in 0.533s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:42 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 Sep 01 02:04:42 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331" returned: 0 in 0.486s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331 Sep 01 02:04:42 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2" returned: 0 in 0.366s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1050753494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b20aaea-3996-4d56-8ed0-8c74620ba15d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175665b91a9642c6a7c0cd25c5fad375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:40Z,use_quota=True,user_id='1334440cfd684d8288d24ee265771d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Creating volume 2b20aaea-3996-4d56-8ed0-8c74620ba15d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:42 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6957eab7-c0ee-4e47-a3dc-2baf197de2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19de937b-0759-4b39-9387-27e71850b4a2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df96c361-fa23-4ae9-a723-35d1cc54f953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:43 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d 1073741824 Sep 01 02:04:43 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Volume volume-19de937b-0759-4b39-9387-27e71850b4a2 (19de937b-0759-4b39-9387-27e71850b4a2): created successfully Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df96c361-fa23-4ae9-a723-35d1cc54f953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Flow 'volume_create_manager' (f0f06736-36a6-4112-a039-ea2d6adaaf61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1d386e5b-69b3-4ca5-a525-384f3b984955 tempest-VolumesTransfersTest-1473009065 None] Created volume successfully. Sep 01 02:04:43 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e.cc5a7b99-46f9-4306-8092-f86c875cb331" returned: 0 in 0.404s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-cc5a7b99-46f9-4306-8092-f86c875cb331" released by "_delete_snapshot" :: held 2.359s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" released by "delete_snapshot" :: held 2.431s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:43 devstack cinder-volume[87425]: WARNING cinder.quota [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1475974510 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1475974510, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:43 devstack cinder-volume[87425]: WARNING cinder.quota [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1475974510 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1475974510, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['d21f262a-9354-41ed-a067-3d0e380159b2', 'c049ad15-671d-4413-a292-7a44ff076947', '4b16c01b-8ad6-4135-a6a7-23eadef3d06f', 'e980ca4f-0a88-457a-a0e7-65b3af8058d7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-2943957b-5ae4-490a-a302-b474cde87470 tempest-GroupSnapshotsTest-637258634 None] group_snapshot 9cf8a71b-db46-427c-b0e6-8bb15972f832: deleted successfully Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Flow 'volume_create_manager' (6c96916b-79de-4104-9342-e8b2739bb10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d296a4-529e-4d92-98f8-44996429a7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d296a4-529e-4d92-98f8-44996429a7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-799232211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eda9d7d-7637-4f42-abe8-688aade1c4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7431117ef20d47ada7dac70ecef9b074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:44Z,use_quota=True,user_id='ab27c562c2574783a7d24ad39f5f05a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af550997-d500-49c7-820d-8f20f5278066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:43 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af550997-d500-49c7-820d-8f20f5278066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4213c9bf-88e8-4085-bdb4-4b60b4356e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4213c9bf-88e8-4085-bdb4-4b60b4356e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eda9d7d-7637-4f42-abe8-688aade1c4cb', 'volume_name': 'volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc67873-37c9-41a0-86d7-b39f35a4391e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc67873-37c9-41a0-86d7-b39f35a4391e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe3f3fe-a832-4d93-8ac9-4de0ad06a0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:43 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Volume 4eda9d7d-7637-4f42-abe8-688aade1c4cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb', 'volume_size': 1} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d 1073741824" returned: 0 in 0.860s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d Sep 01 02:04:43 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d" returned: 0 in 0.261s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-799232211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eda9d7d-7637-4f42-abe8-688aade1c4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7431117ef20d47ada7dac70ecef9b074',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:44Z,use_quota=True,user_id='ab27c562c2574783a7d24ad39f5f05a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Creating volume 4eda9d7d-7637-4f42-abe8-688aade1c4cb {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:44 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb 1073741824 Sep 01 02:04:44 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Attempting download of 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume 2b20aaea-3996-4d56-8ed0-8c74620ba15d. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2123565-868b-4bfa-b25a-e2c937b36441]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_io2jbgqu {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_io2jbgqu Sep 01 02:04:44 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a7846bb3-9b94-4c28-8558-e1cb08536b8c tempest-VolumesTransfersTest-1638244340 None] Transfer volume completed successfully. Sep 01 02:04:44 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_io2jbgqu" returned: 0 in 0.453s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_io2jbgqu {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "cinder-quobyte-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:44 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb 1073741824" returned: 0 in 0.662s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" acquired by "delete_volume" :: waited 0.052s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110f4a6-7066-4838-93e5-c23e3cbd380f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_io2jbgqu Sep 01 02:04:44 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb Sep 01 02:04:45 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e Sep 01 02:04:45 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_io2jbgqu" returned: 1 in 0.450s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_io2jbgqu' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed9a472-5f71-4a35-8b4e-9ba3296db2ca]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb" returned: 0 in 0.338s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe3f3fe-a832-4d93-8ac9-4de0ad06a0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a77077-0776-4845-8778-81fc1a574399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:45 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD Sep 01 02:04:45 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Volume volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb (4eda9d7d-7637-4f42-abe8-688aade1c4cb): created successfully Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a77077-0776-4845-8778-81fc1a574399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Flow 'volume_create_manager' (6c96916b-79de-4104-9342-e8b2739bb10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-862e08ef-7951-41f4-a738-357fdba43bd8 req-fb1ecabe-f29d-4375-bac8-9c08d253a7f3 tempest-VolumesSnapshotsTestJSON-1688623366 None] Created volume successfully. Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Acquiring lock "cinder-19de937b-0759-4b39-9387-27e71850b4a2-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Lock "cinder-19de937b-0759-4b39-9387-27e71850b4a2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Acquiring lock "cinder-quobyte-19de937b-0759-4b39-9387-27e71850b4a2" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:45 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" returned: 0 in 0.578s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Lock "cinder-quobyte-19de937b-0759-4b39-9387-27e71850b4a2" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:45 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e Sep 01 02:04:45 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea994968-8896-4c21-b2af-7b5639a41b2b]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] 694eb3d8-3f60-4f10-a358-172d9ec581ff was qcow2, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d Sep 01 02:04:45 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 Sep 01 02:04:45 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" returned: 0 in 0.285s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Lock "cinder-quobyte-44442ee6-c5a3-4c9d-8a4f-a0e603f7e09e" released by "delete_volume" :: held 0.942s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['18a1c0ef-9e64-4224-ab95-53ba218b4df0'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:45 devstack cinder-volume[87425]: WARNING cinder.quota [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1475974510 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1475974510, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Created reservations ['610b4dd3-f12c-4f66-a2ea-b7fc84ab5303', '4d55126a-bf60-4f03-b1f6-e2568ac2a64e', 'fe3a892d-17a5-4370-be92-cd9adfcea752', '853f23d3-c3ef-4b2d-b8a8-bc78f86ffaf7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:45 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2" returned: 0 in 0.460s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2 Sep 01 02:04:46 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[92411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:46 devstack sudo[92411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19de937b-0759-4b39-9387-27e71850b4a2" returned: 0 in 0.387s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Lock "cinder-quobyte-19de937b-0759-4b39-9387-27e71850b4a2" released by "delete_volume" :: held 0.924s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Creating offline snapshot 2a2a2701-d9ce-4c89-aba6-c5884aebe46d of volume 4eda9d7d-7637-4f42-abe8-688aade1c4cb {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[80519454-9da3-4396-a32c-b22fb5645e8d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[92411]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.423s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Created reservations ['f2d1603e-d0d1-404d-8bec-572131aa3c6c', '8ab57097-4d0a-430a-bf9a-7ae6dd711045', '846fd79f-ed18-4089-bc1a-9a7db8661f99', 'a202bdc7-e487-4980-8d8d-489eb9284f88'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d5be7e54-f60f-4ca4-b2a3-2251079ec133 tempest-GroupSnapshotsTest-637258634 None] Delete group completed successfully. Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:46 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb Sep 01 02:04:46 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:47 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.336s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:47 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Deleted volume successfully. Sep 01 02:04:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ec4c7117-fc2d-40d8-a578-2365db7da265 tempest-VolumesTransfersTest-868131093 None] Lock "cinder-19de937b-0759-4b39-9387-27e71850b4a2-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:47 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb" returned: 0 in 0.577s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:47 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d 1G Sep 01 02:04:47 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:47 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d 1G" returned: 0 in 0.553s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:47 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d Sep 01 02:04:47 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:48 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d" returned: 0 in 0.411s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d is being set with open permissions: ugo+rw Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d Sep 01 02:04:48 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:48 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d" returned: 0 in 2.548s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_oygf1rq_devstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:04:48 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Converted 112.00 MB image at 43.93 MB/s Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d 1G Sep 01 02:04:48 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:48 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Flow 'volume_create_manager' (7663604a-7b5a-4575-b4f9-c9cf8c9bdf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573de2a1-9044-4712-a1f4-ec0e73aa2c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573de2a1-9044-4712-a1f4-ec0e73aa2c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1968435291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7936b3-9e97-4050-bbde-ed26881d0f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4416ac84820f49c0af13b2b0ceb72bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:48Z,use_quota=True,user_id='56a45369bb88421198d426fd1c87ec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1aef750-5a77-4464-9693-c27e5665b2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1aef750-5a77-4464-9693-c27e5665b2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf5031d-4ffb-4353-8783-b8810da2603d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf5031d-4ffb-4353-8783-b8810da2603d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7936b3-9e97-4050-bbde-ed26881d0f3b', 'volume_name': 'volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd788d7d-498b-4e4c-a7d1-00023db9ca64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd788d7d-498b-4e4c-a7d1-00023db9ca64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef7db7b-2f82-4725-8112-dfb09b2ce280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:48 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Volume fd7936b3-9e97-4050-bbde-ed26881d0f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b', 'volume_size': 1} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[92453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.info Sep 01 02:04:48 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:48 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d 1G" returned: 0 in 0.503s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Downloaded image 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume 2b20aaea-3996-4d56-8ed0-8c74620ba15d successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff for user 1334440cfd684d8288d24ee265771d89 is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Marking volume 2b20aaea-3996-4d56-8ed0-8c74620ba15d as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Copying metadata from image 694eb3d8-3f60-4f10-a358-172d9ec581ff to 2b20aaea-3996-4d56-8ed0-8c74620ba15d. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Creating volume glance metadata for volume 2b20aaea-3996-4d56-8ed0-8c74620ba15d backed by image 694eb3d8-3f60-4f10-a358-172d9ec581ff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89d417fb-1af9-41f4-a480-327001d5806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012558d1-4991-4cb6-82d3-09b268539494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:48 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Volume volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d (2b20aaea-3996-4d56-8ed0-8c74620ba15d): created successfully Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012558d1-4991-4cb6-82d3-09b268539494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Flow 'volume_create_manager' (b42d9862-fffb-4e21-b2d8-81de5c6dd6ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:48 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d742057d-0ad7-47a3-9711-13f571a3b118 tempest-ServerActionsTestOtherA-1855892746 None] Created volume successfully. Sep 01 02:04:48 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.info" returned: 0 in 0.321s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.info is being set with open permissions: ugo+rw Sep 01 02:04:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.info Sep 01 02:04:48 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.info" returned: 0 in 0.305s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.814s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1968435291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7936b3-9e97-4050-bbde-ed26881d0f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4416ac84820f49c0af13b2b0ceb72bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:48Z,use_quota=True,user_id='56a45369bb88421198d426fd1c87ec50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Creating volume fd7936b3-9e97-4050-bbde-ed26881d0f3b {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:49 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:49 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b 1073741824 Sep 01 02:04:49 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-a1d20039-ea26-49f1-9e7f-a7317a7955dc req-486e6bd9-65b6-4956-a728-ee71af80b7f4 tempest-VolumesSnapshotsTestJSON-1688623366 None] Create snapshot completed successfully Sep 01 02:04:49 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b 1073741824" returned: 0 in 0.614s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:49 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b Sep 01 02:04:49 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "cinder-2a2a2701-d9ce-4c89-aba6-c5884aebe46d-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-2a2a2701-d9ce-4c89-aba6-c5884aebe46d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "cinder-quobyte-4eda9d7d-7637-4f42-abe8-688aade1c4cb" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-quobyte-4eda9d7d-7637-4f42-abe8-688aade1c4cb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "cinder-quobyte-2a2a2701-d9ce-4c89-aba6-c5884aebe46d" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-quobyte-2a2a2701-d9ce-4c89-aba6-c5884aebe46d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Deleting offline snapshot 2a2a2701-d9ce-4c89-aba6-c5884aebe46d of volume 4eda9d7d-7637-4f42-abe8-688aade1c4cb {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] snapshot_file for this snap is: volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec34a82d-6d50-4f97-89b9-fccbb7320d79]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:50 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b" returned: 0 in 0.363s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef7db7b-2f82-4725-8112-dfb09b2ce280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f991e21d-ac4e-4289-be70-52a6ab8b21ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:50 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Volume volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b (fd7936b3-9e97-4050-bbde-ed26881d0f3b): created successfully Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f991e21d-ac4e-4289-be70-52a6ab8b21ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Flow 'volume_create_manager' (7663604a-7b5a-4575-b4f9-c9cf8c9bdf8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:50 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d Sep 01 02:04:50 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4ee7dd0d-b7ae-47a4-94ad-260b16c64bd1 tempest-VolumesTransfersTest-1473009065 None] Created volume successfully. Sep 01 02:04:50 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:50 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d" returned: 0 in 0.552s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0abaa18-00d1-41f2-9d8e-f04755cd140f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:50 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb Sep 01 02:04:50 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Acquiring lock "cinder-fd7936b3-9e97-4050-bbde-ed26881d0f3b-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Lock "cinder-fd7936b3-9e97-4050-bbde-ed26881d0f3b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Acquiring lock "cinder-quobyte-fd7936b3-9e97-4050-bbde-ed26881d0f3b" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Lock "cinder-quobyte-fd7936b3-9e97-4050-bbde-ed26881d0f3b" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[57318c1e-7606-44d4-8725-6ff993ac03a7]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:51 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb" returned: 0 in 0.580s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:51 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d Sep 01 02:04:51 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:51 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b Sep 01 02:04:51 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:51 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b" returned: 0 in 0.618s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:51 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b Sep 01 02:04:51 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:51 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d" returned: 0 in 0.508s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:51 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d Sep 01 02:04:51 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:52 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd7936b3-9e97-4050-bbde-ed26881d0f3b" returned: 0 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Lock "cinder-quobyte-fd7936b3-9e97-4050-bbde-ed26881d0f3b" released by "delete_volume" :: held 1.102s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:52 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb.2a2a2701-d9ce-4c89-aba6-c5884aebe46d" returned: 0 in 0.394s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-quobyte-2a2a2701-d9ce-4c89-aba6-c5884aebe46d" released by "_delete_snapshot" :: held 2.235s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-quobyte-4eda9d7d-7637-4f42-abe8-688aade1c4cb" released by "delete_snapshot" :: held 2.272s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Created reservations ['ca5f019a-3f5f-4582-a93d-3f667c960b1f', 'f4075f0d-5463-4e71-9179-802d8dbb271a', '3e01c2ef-671c-4b42-9b73-d1978d68554e', '0465dbcc-7c1c-4477-a804-7aee347d44e7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.quota [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Created reservations ['1ddf6ec5-44d4-45d3-ad3e-be67a7c4cfe7', '5601778b-02ec-4752-8322-378b6509187d', '6f0d2b5f-b78c-4b01-aa54-3bc3cc0635af', '85c57c88-1b56-44e7-b02d-ac908b80b022'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:52 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:52 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Delete snapshot completed successfully. Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-1a4cef2b-c3de-4d8f-90be-0d533cbf60ff req-20a15381-7bd8-445b-aa6f-ad63f4c2eb23 tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-2a2a2701-d9ce-4c89-aba6-c5884aebe46d-delete_snapshot" released by "delete_snapshot" :: held 2.670s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:52 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.327s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Deleted volume successfully. Sep 01 02:04:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d25fa111-a502-4fe9-97ee-43f1311bbdb7 tempest-VolumesTransfersTest-868131093 None] Lock "cinder-fd7936b3-9e97-4050-bbde-ed26881d0f3b-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-7d79b1a2-e2a9-4dba-a218-32ed8341bf03 req-4689d941-cdfc-456d-a008-6b31eddfb01b tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-7d79b1a2-e2a9-4dba-a218-32ed8341bf03 req-4689d941-cdfc-456d-a008-6b31eddfb01b tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-7d79b1a2-e2a9-4dba-a218-32ed8341bf03 req-4689d941-cdfc-456d-a008-6b31eddfb01b tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "cinder-4eda9d7d-7637-4f42-abe8-688aade1c4cb-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-4eda9d7d-7637-4f42-abe8-688aade1c4cb-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-7d79b1a2-e2a9-4dba-a218-32ed8341bf03 req-4689d941-cdfc-456d-a008-6b31eddfb01b tempest-ServerActionsTestOtherA-1855892746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56a62961-1591-40f6-a902-d8845d29e152', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "cinder-quobyte-4eda9d7d-7637-4f42-abe8-688aade1c4cb" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-quobyte-4eda9d7d-7637-4f42-abe8-688aade1c4cb" acquired by "delete_volume" :: waited 0.086s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607a8a9-2e36-4593-a0f8-bec9702be386]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:54 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-7d79b1a2-e2a9-4dba-a218-32ed8341bf03 req-4689d941-cdfc-456d-a008-6b31eddfb01b tempest-ServerActionsTestOtherA-1855892746 None] attachment_update completed successfully. Sep 01 02:04:54 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb Sep 01 02:04:54 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:54 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb" returned: 0 in 0.657s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:54 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb Sep 01 02:04:54 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:55 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4eda9d7d-7637-4f42-abe8-688aade1c4cb" returned: 0 in 0.486s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-quobyte-4eda9d7d-7637-4f42-abe8-688aade1c4cb" released by "delete_volume" :: held 1.267s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG cinder.quota [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Created reservations ['13d10e4e-da94-474a-80de-961dc7f2414f', '35e50fc2-80a5-4c3c-8698-1557ea6154d0', 'f9f811d4-9c99-4312-979f-76a4003b096d', '21b48c0f-2bdd-4acf-95f6-c9764dc8cb2b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:55 devstack sudo[92521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:04:55 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:55 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.367s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG cinder.manager [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Deleted volume successfully. Sep 01 02:04:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-622f3553-d54a-48c5-a42b-569f819056c1 req-46bc27dd-bef2-4ba2-acf0-9d6d691afb9c tempest-VolumesSnapshotsTestJSON-1688623366 None] Lock "cinder-4eda9d7d-7637-4f42-abe8-688aade1c4cb-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:04 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Flow 'volume_create_manager' (5ded06d5-abc8-4f3c-8b2d-8f64a1e1a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebc6d61-35b6-4ddf-bd3f-941aeada5d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebc6d61-35b6-4ddf-bd3f-941aeada5d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-778657824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4985da5e-2439-482c-867f-8780e5ccd727,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='834a869c7cb74ab9ad08cbc67186f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:05Z,use_quota=True,user_id='5871ab4e7aa14bb1937e74e3c5d520eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afe6bf5-9c02-47b8-9419-0b4520b7e533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afe6bf5-9c02-47b8-9419-0b4520b7e533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba334f7-f813-49b7-bb84-25f1ce552bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba334f7-f813-49b7-bb84-25f1ce552bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4985da5e-2439-482c-867f-8780e5ccd727', 'volume_name': 'volume-4985da5e-2439-482c-867f-8780e5ccd727', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e89b32-3a3a-48d4-85d0-3711c9778953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e89b32-3a3a-48d4-85d0-3711c9778953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7055dbd5-d931-47af-a01f-a41698f17f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:05 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Volume 4985da5e-2439-482c-867f-8780e5ccd727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4985da5e-2439-482c-867f-8780e5ccd727', 'volume_size': 1} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-778657824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4985da5e-2439-482c-867f-8780e5ccd727,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='834a869c7cb74ab9ad08cbc67186f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:05Z,use_quota=True,user_id='5871ab4e7aa14bb1937e74e3c5d520eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Creating volume 4985da5e-2439-482c-867f-8780e5ccd727 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:05 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:05:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:05 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 1073741824 Sep 01 02:05:05 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:06 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 1073741824" returned: 0 in 0.927s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:06 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 Sep 01 02:05:06 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:06 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:06 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:06 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.377s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:05:06 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727" returned: 0 in 0.729s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7055dbd5-d931-47af-a01f-a41698f17f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4985da5e-2439-482c-867f-8780e5ccd727', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d78a86-e15c-44c8-a3de-1f406d23e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:07 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Volume volume-4985da5e-2439-482c-867f-8780e5ccd727 (4985da5e-2439-482c-867f-8780e5ccd727): created successfully Sep 01 02:05:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d78a86-e15c-44c8-a3de-1f406d23e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Flow 'volume_create_manager' (5ded06d5-abc8-4f3c-8b2d-8f64a1e1a808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:07 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b6677c67-f490-4a29-b8d9-9179bf503d49 tempest-VolumesTestJSON-291814199 None] Created volume successfully. Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Flow 'volume_create_manager' (223fc158-3c45-42af-8651-bf8f08997349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9388e805-53bf-4827-bc34-bb6a17ab14fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3cd8f7af-5667-4734-bc54-877bdcbec115 tempest-GroupsV320Test-469697872 None] Group tempest-GroupsV320Test-Group-251857742: creating Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9388e805-53bf-4827-bc34-bb6a17ab14fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-27268694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390613ea-9611-4095-9240-857584efa772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e9249b8f5e44f8bd57d089cf6d2f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:08Z,use_quota=True,user_id='810b76ed4434408599ba0a5690dc9f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e8dfe0-a88a-44ff-8353-d5a0b9c0fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e8dfe0-a88a-44ff-8353-d5a0b9c0fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09378863-9e5f-4041-ab67-12abab367add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09378863-9e5f-4041-ab67-12abab367add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390613ea-9611-4095-9240-857584efa772', 'volume_name': 'volume-390613ea-9611-4095-9240-857584efa772', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25280ba1-75b5-479b-a842-cf348cfe2f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25280ba1-75b5-479b-a842-cf348cfe2f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c84453e-fb39-461b-bc4b-4d0c50ad5a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Volume 390613ea-9611-4095-9240-857584efa772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390613ea-9611-4095-9240-857584efa772', 'volume_size': 1} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-27268694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390613ea-9611-4095-9240-857584efa772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e9249b8f5e44f8bd57d089cf6d2f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:08Z,use_quota=True,user_id='810b76ed4434408599ba0a5690dc9f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Creating volume 390613ea-9611-4095-9240-857584efa772 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:08 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:05:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:08 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 1073741824 Sep 01 02:05:08 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3cd8f7af-5667-4734-bc54-877bdcbec115 tempest-GroupsV320Test-469697872 None] Group tempest-GroupsV320Test-Group-251857742: created successfully Sep 01 02:05:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3cd8f7af-5667-4734-bc54-877bdcbec115 tempest-GroupsV320Test-469697872 None] Create group completed successfully. Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Flow 'volume_create_manager' (ea3c0f2b-112b-49bf-8d66-2d39b96f67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a7b93e-46fc-4434-aa94-3991c7a80a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a7b93e-46fc-4434-aa94-3991c7a80a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1586490515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be870824-b1c6-4185-88f1-ed80d07d658f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='834a869c7cb74ab9ad08cbc67186f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:09Z,use_quota=True,user_id='5871ab4e7aa14bb1937e74e3c5d520eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654512ad-44d8-4994-aa63-2d358a260cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654512ad-44d8-4994-aa63-2d358a260cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82b938b-e160-4cd5-ae53-78aae633d9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82b938b-e160-4cd5-ae53-78aae633d9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be870824-b1c6-4185-88f1-ed80d07d658f', 'volume_name': 'volume-be870824-b1c6-4185-88f1-ed80d07d658f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc01ef9-f2b8-4fdf-abdd-a18e21c94d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc01ef9-f2b8-4fdf-abdd-a18e21c94d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b859b543-0305-4acd-9fbf-5560291ee3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Volume be870824-b1c6-4185-88f1-ed80d07d658f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be870824-b1c6-4185-88f1-ed80d07d658f', 'volume_size': 1} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:09 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 1073741824" returned: 0 in 1.027s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:09 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 Sep 01 02:05:09 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:10 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772" returned: 0 in 0.637s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.737s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1586490515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be870824-b1c6-4185-88f1-ed80d07d658f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='834a869c7cb74ab9ad08cbc67186f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:09Z,use_quota=True,user_id='5871ab4e7aa14bb1937e74e3c5d520eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Creating volume be870824-b1c6-4185-88f1-ed80d07d658f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:10 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:10 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f 1073741824 Sep 01 02:05:10 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c84453e-fb39-461b-bc4b-4d0c50ad5a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390613ea-9611-4095-9240-857584efa772', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5fb6d2-eb87-428f-b248-34ff9671283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:10 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Volume volume-390613ea-9611-4095-9240-857584efa772 (390613ea-9611-4095-9240-857584efa772): created successfully Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5fb6d2-eb87-428f-b248-34ff9671283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Flow 'volume_create_manager' (223fc158-3c45-42af-8651-bf8f08997349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6ae70062-52f8-403b-a563-b6bf047fa1d4 tempest-VolumesTransfersV357Test-140985499 None] Created volume successfully. Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Created reservations ['3c300ac7-45da-4d52-8f46-5edfc711f8c7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:10 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:10 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:11 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f 1073741824" returned: 0 in 0.769s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:11 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.472s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0407abcb-c839-4cd4-a929-9f7e1640da73 tempest-GroupsV320Test-469697872 None] Delete group completed successfully. Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:11 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f Sep 01 02:05:11 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:11 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f" returned: 0 in 0.455s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b859b543-0305-4acd-9fbf-5560291ee3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be870824-b1c6-4185-88f1-ed80d07d658f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787763a5-fec3-4cd5-8862-02c2ec7d73f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:11 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Volume volume-be870824-b1c6-4185-88f1-ed80d07d658f (be870824-b1c6-4185-88f1-ed80d07d658f): created successfully Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (787763a5-fec3-4cd5-8862-02c2ec7d73f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Flow 'volume_create_manager' (ea3c0f2b-112b-49bf-8d66-2d39b96f67dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c0cbdfae-9463-4923-b5c7-24b307a30e71 tempest-VolumesTestJSON-291814199 None] Created volume successfully. Sep 01 02:05:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-49e30b75-d946-4d7f-a5d6-f68a855c3e0e tempest-VolumesTransfersV357Test-185128963 None] Transfer volume completed successfully. Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Flow 'volume_create_manager' (ad5600d7-3d01-4890-a3a4-a5dcc9f17751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8037dc57-309f-4ed7-87c0-1393bb3fdf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8037dc57-309f-4ed7-87c0-1393bb3fdf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1597468767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d4f935-67a5-4a04-a926-ed85a3dedf72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='834a869c7cb74ab9ad08cbc67186f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:14Z,use_quota=True,user_id='5871ab4e7aa14bb1937e74e3c5d520eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39ef576-107c-403b-a822-7e0c27adebd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39ef576-107c-403b-a822-7e0c27adebd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e601f-9d37-4a43-bf7a-3590a7cfb66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (695e601f-9d37-4a43-bf7a-3590a7cfb66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d4f935-67a5-4a04-a926-ed85a3dedf72', 'volume_name': 'volume-77d4f935-67a5-4a04-a926-ed85a3dedf72', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd250377-64bf-4fbb-aadc-047d45831b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd250377-64bf-4fbb-aadc-047d45831b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaf1523-345f-41e1-91d9-394fb2eb39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:14 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Volume 77d4f935-67a5-4a04-a926-ed85a3dedf72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d4f935-67a5-4a04-a926-ed85a3dedf72', 'volume_size': 1} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1597468767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d4f935-67a5-4a04-a926-ed85a3dedf72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='834a869c7cb74ab9ad08cbc67186f42c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:14Z,use_quota=True,user_id='5871ab4e7aa14bb1937e74e3c5d520eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Creating volume 77d4f935-67a5-4a04-a926-ed85a3dedf72 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:14 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:14 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 1073741824 Sep 01 02:05:14 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Acquiring lock "cinder-390613ea-9611-4095-9240-857584efa772-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Lock "cinder-390613ea-9611-4095-9240-857584efa772-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Acquiring lock "cinder-quobyte-390613ea-9611-4095-9240-857584efa772" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Lock "cinder-quobyte-390613ea-9611-4095-9240-857584efa772" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb11df3-ce3a-4f9b-99d1-ebaecb520806]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:14 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 Sep 01 02:05:14 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:15 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 1073741824" returned: 0 in 1.001s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:15 devstack sudo[93016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 Sep 01 02:05:15 devstack sudo[93016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:15 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772" returned: 0 in 0.663s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:15 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772 Sep 01 02:05:15 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-be662037-5ba0-45a8-9f71-c62b530ac171 req-a9225939-648c-4785-90d3-51bd71d67038 tempest-ServerActionsTestOtherA-1855892746 None] Terminate volume connection completed successfully. Sep 01 02:05:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-be662037-5ba0-45a8-9f71-c62b530ac171 req-a9225939-648c-4785-90d3-51bd71d67038 tempest-ServerActionsTestOtherA-1855892746 None] Deleting attachment 56a62961-1591-40f6-a902-d8845d29e152. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:15 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-390613ea-9611-4095-9240-857584efa772" returned: 0 in 0.542s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Lock "cinder-quobyte-390613ea-9611-4095-9240-857584efa772" released by "delete_volume" :: held 1.305s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Created reservations ['4ed642ab-e95e-4661-b10e-67058be0303b', 'f72470af-f83b-4962-bb11-170e220f87a2', '08bf0415-e8e6-4807-96f3-6f436fc31679', 'c0e958b7-a0b1-43b9-9f1f-28bb554b8e85'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:16 devstack sudo[93016]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72" returned: 0 in 0.823s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eaf1523-345f-41e1-91d9-394fb2eb39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d4f935-67a5-4a04-a926-ed85a3dedf72', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abee25ff-46ee-4ee4-865c-34b996c4e129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:16 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Volume volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 (77d4f935-67a5-4a04-a926-ed85a3dedf72): created successfully Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abee25ff-46ee-4ee4-865c-34b996c4e129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Flow 'volume_create_manager' (ad5600d7-3d01-4890-a3a4-a5dcc9f17751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d38dbd44-8f54-4a10-ac74-43024257db94 tempest-VolumesTestJSON-291814199 None] Created volume successfully. Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:16 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:16 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:16 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.342s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Deleted volume successfully. Sep 01 02:05:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f05af80d-6c79-40a2-8f3f-d3f4e878d965 tempest-VolumesTransfersV357Test-1468206101 None] Lock "cinder-390613ea-9611-4095-9240-857584efa772-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Flow 'volume_create_manager' (68e05afd-f63b-4a7e-bf3f-f917db675531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e6b7ee-f077-4bad-83c3-513dd8622280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e6b7ee-f077-4bad-83c3-513dd8622280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1994320517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b12722-b6d6-4ba3-a966-b24a92fe65ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e9249b8f5e44f8bd57d089cf6d2f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:18Z,use_quota=True,user_id='810b76ed4434408599ba0a5690dc9f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4884cf-814e-4eb5-9f93-cebc3148c04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4884cf-814e-4eb5-9f93-cebc3148c04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338f0820-3df8-4832-a34d-986896b9ad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338f0820-3df8-4832-a34d-986896b9ad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b12722-b6d6-4ba3-a966-b24a92fe65ce', 'volume_name': 'volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03627d19-b934-48ad-a5f6-728a115f0111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03627d19-b934-48ad-a5f6-728a115f0111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd85cefd-949b-40b4-87ad-7d0afd632a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:17 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Volume 62b12722-b6d6-4ba3-a966-b24a92fe65ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce', 'volume_size': 1} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1994320517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b12722-b6d6-4ba3-a966-b24a92fe65ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25e9249b8f5e44f8bd57d089cf6d2f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:18Z,use_quota=True,user_id='810b76ed4434408599ba0a5690dc9f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Creating volume 62b12722-b6d6-4ba3-a966-b24a92fe65ce {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:18 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:18 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce 1073741824 Sep 01 02:05:18 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:18 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce 1073741824" returned: 0 in 0.828s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-be662037-5ba0-45a8-9f71-c62b530ac171 req-63ea0f9b-a8e8-4275-9a96-a75c7025ba8d tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:18 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce Sep 01 02:05:18 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Acquiring lock "cinder-77d4f935-67a5-4a04-a926-ed85a3dedf72-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Lock "cinder-77d4f935-67a5-4a04-a926-ed85a3dedf72-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Acquiring lock "cinder-quobyte-77d4f935-67a5-4a04-a926-ed85a3dedf72" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Lock "cinder-quobyte-77d4f935-67a5-4a04-a926-ed85a3dedf72" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45c24ff-23e7-495f-b9b3-e8fc9543b12e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:19 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 Sep 01 02:05:19 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:19 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-be662037-5ba0-45a8-9f71-c62b530ac171 req-63ea0f9b-a8e8-4275-9a96-a75c7025ba8d tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.400s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-be662037-5ba0-45a8-9f71-c62b530ac171 req-63ea0f9b-a8e8-4275-9a96-a75c7025ba8d tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd85cefd-949b-40b4-87ad-7d0afd632a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3ab782-255c-41d9-b5fc-f2caeda43fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Volume volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce (62b12722-b6d6-4ba3-a966-b24a92fe65ce): created successfully Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3ab782-255c-41d9-b5fc-f2caeda43fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Flow 'volume_create_manager' (68e05afd-f63b-4a7e-bf3f-f917db675531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8a1b4297-730a-4800-868e-48059edc19b9 tempest-VolumesTransfersV357Test-140985499 None] Created volume successfully. Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-be662037-5ba0-45a8-9f71-c62b530ac171 req-63ea0f9b-a8e8-4275-9a96-a75c7025ba8d tempest-ServerActionsTestOtherA-1855892746 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '754e1e5b-06aa-47f8-a14c-b935abd5299b', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-be662037-5ba0-45a8-9f71-c62b530ac171 req-63ea0f9b-a8e8-4275-9a96-a75c7025ba8d tempest-ServerActionsTestOtherA-1855892746 None] attachment_update completed successfully. Sep 01 02:05:19 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72" returned: 0 in 0.487s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:19 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72 Sep 01 02:05:19 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:20 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-77d4f935-67a5-4a04-a926-ed85a3dedf72" returned: 0 in 0.469s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Lock "cinder-quobyte-77d4f935-67a5-4a04-a926-ed85a3dedf72" released by "delete_volume" :: held 1.049s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Created reservations ['97d2588f-880c-4b24-b867-7b6eb792cfc6', '3973d00b-c874-422f-8b8e-2d138522385c', 'b5418da8-57e1-4247-a3d5-3e9de91dbd53', 'ccd8f59d-c94e-458e-977c-eb1bd0150770'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:20 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:20 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Acquiring lock "cinder-62b12722-b6d6-4ba3-a966-b24a92fe65ce-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Lock "cinder-62b12722-b6d6-4ba3-a966-b24a92fe65ce-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Acquiring lock "cinder-quobyte-62b12722-b6d6-4ba3-a966-b24a92fe65ce" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Lock "cinder-quobyte-62b12722-b6d6-4ba3-a966-b24a92fe65ce" acquired by "delete_volume" :: waited 0.043s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d69a50-2c82-43b6-aa20-e922634024b3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:21 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.557s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Deleted volume successfully. Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=149,cinder:INSERT=44,cinder:UPDATE=164,cinder:DELETE=16 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5c6250b8-4da1-46dc-9e52-4ff9f7508ea6 tempest-VolumesTestJSON-291814199 None] Lock "cinder-77d4f935-67a5-4a04-a926-ed85a3dedf72-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:21 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce Sep 01 02:05:21 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Acquiring lock "cinder-be870824-b1c6-4185-88f1-ed80d07d658f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Lock "cinder-be870824-b1c6-4185-88f1-ed80d07d658f-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=151,cinder:UPDATE=168,cinder:DELETE=5,cinder:INSERT=46 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Acquiring lock "cinder-quobyte-be870824-b1c6-4185-88f1-ed80d07d658f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Lock "cinder-quobyte-be870824-b1c6-4185-88f1-ed80d07d658f" acquired by "delete_volume" :: waited 0.040s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[83abe6ba-d77d-4686-90b6-31656d92bce3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:21 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce" returned: 0 in 0.827s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:21 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce Sep 01 02:05:21 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:21 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f Sep 01 02:05:21 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:22 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-62b12722-b6d6-4ba3-a966-b24a92fe65ce" returned: 0 in 0.423s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Lock "cinder-quobyte-62b12722-b6d6-4ba3-a966-b24a92fe65ce" released by "delete_volume" :: held 1.389s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:22 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f" returned: 0 in 0.644s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Created reservations ['bfb952ad-dead-4fa0-9732-3f8d5ce03037', '515eb49d-7bd1-4099-b966-0bde61db9e8d', '8ea899a2-4f8e-4ba8-bf2d-ec49cb7a207a', '72217e3f-f71e-4c5b-b969-10f153c28dba'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:22 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f Sep 01 02:05:22 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:22 devstack sudo[93533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:22 devstack sudo[93533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:23 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-be870824-b1c6-4185-88f1-ed80d07d658f" returned: 0 in 0.715s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Lock "cinder-quobyte-be870824-b1c6-4185-88f1-ed80d07d658f" released by "delete_volume" :: held 1.488s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:23 devstack sudo[93533]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.638s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Deleted volume successfully. Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdbcec1c-cba0-4f0f-ac3b-6e719068991d tempest-VolumesTransfersV357Test-1468206101 None] Lock "cinder-62b12722-b6d6-4ba3-a966-b24a92fe65ce-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Created reservations ['39f84141-0917-4622-b4b0-f66bb98d9c6f', '9eb253a4-8485-4d3f-b0d9-5fab09c44d1f', 'bed25a2d-5587-4b09-b9fe-3d1817f0b707', 'c7294304-8f03-4573-9c1e-738cfa8fad22'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:23 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:23 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:24 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Acquiring lock "cinder-4985da5e-2439-482c-867f-8780e5ccd727-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Deleted volume successfully. Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Lock "cinder-4985da5e-2439-482c-867f-8780e5ccd727-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cd57e39e-14e1-4004-8789-0e5b42eb4562 tempest-VolumesTestJSON-291814199 None] Lock "cinder-be870824-b1c6-4185-88f1-ed80d07d658f-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Acquiring lock "cinder-quobyte-4985da5e-2439-482c-867f-8780e5ccd727" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Lock "cinder-quobyte-4985da5e-2439-482c-867f-8780e5ccd727" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[38460e2d-ec1f-47b3-9434-5547ff2ab2f2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:24 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 Sep 01 02:05:24 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:24 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727" returned: 0 in 0.647s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:24 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727 Sep 01 02:05:24 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:25 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4985da5e-2439-482c-867f-8780e5ccd727" returned: 0 in 0.651s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Lock "cinder-quobyte-4985da5e-2439-482c-867f-8780e5ccd727" released by "delete_volume" :: held 1.398s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Created reservations ['a08e3b68-490b-4783-99c4-6feea6608e44', '0d2953d6-109c-4fe1-85af-0eb513d10ebe', '6a47cce6-8985-44c4-ab5c-8c15d9dc4041', 'ecdbcb38-4355-4bfd-9740-00fae4167a42'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:26 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:26 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:26 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.582s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:26 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Deleted volume successfully. Sep 01 02:05:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-573ad4d2-cc8e-462f-bbb8-d0b6ae4cd153 tempest-VolumesTestJSON-291814199 None] Lock "cinder-4985da5e-2439-482c-867f-8780e5ccd727-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0548e7f1-1462-4161-ad5c-4526ab317981 tempest-GroupsV314Test-1347903368 None] Group tempest-GroupsV314Test-Group-455405367: creating Sep 01 02:05:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0548e7f1-1462-4161-ad5c-4526ab317981 tempest-GroupsV314Test-1347903368 None] Group tempest-GroupsV314Test-Group-455405367: created successfully Sep 01 02:05:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0548e7f1-1462-4161-ad5c-4526ab317981 tempest-GroupsV314Test-1347903368 None] Create group completed successfully. Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Flow 'volume_create_manager' (9b6b9cc1-24f7-4a0d-9ff1-5f8885c79662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae3c8cd-b701-42ea-bfa4-c782352bcded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae3c8cd-b701-42ea-bfa4-c782352bcded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712540906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1a7b398d-3bc0-4f0d-9ddb-6c409eb84525,host='devstack@QuobyteHD#QuobyteHD',id=c5e94059-a986-4829-87d3-d6b030a3fd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eb28ac4f344e1b91fcae529aefebd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:37Z,use_quota=True,user_id='a2fa05895404410893bae12090ca9989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bd450d4-ecda-4a23-a811-a1a6c31b9b9f),volume_type_id=3bd450d4-ecda-4a23-a811-a1a6c31b9b9f)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c444e50-7f00-45b1-8e84-c37ecaf60e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c444e50-7f00-45b1-8e84-c37ecaf60e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3846d9d-5d7a-4c5f-a1e2-e4228bed8d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3846d9d-5d7a-4c5f-a1e2-e4228bed8d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e94059-a986-4829-87d3-d6b030a3fd6c', 'volume_name': 'volume-c5e94059-a986-4829-87d3-d6b030a3fd6c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f261f7b1-225a-44d1-aa10-ef42946ecca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f261f7b1-225a-44d1-aa10-ef42946ecca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4835c9fc-27e1-43ce-9c1c-9e1f4d995f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:36 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Volume c5e94059-a986-4829-87d3-d6b030a3fd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e94059-a986-4829-87d3-d6b030a3fd6c', 'volume_size': 1} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1a7b398d-3bc0-4f0d-9ddb-6c409eb84525,created_at=2026-09-01T00:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712540906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1a7b398d-3bc0-4f0d-9ddb-6c409eb84525,host='devstack@QuobyteHD#QuobyteHD',id=c5e94059-a986-4829-87d3-d6b030a3fd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34eb28ac4f344e1b91fcae529aefebd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:37Z,use_quota=True,user_id='a2fa05895404410893bae12090ca9989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bd450d4-ecda-4a23-a811-a1a6c31b9b9f),volume_type_id=3bd450d4-ecda-4a23-a811-a1a6c31b9b9f)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Creating volume c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:36 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:05:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:36 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c 1073741824 Sep 01 02:05:36 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:37 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c 1073741824" returned: 0 in 0.563s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:37 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c Sep 01 02:05:37 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:37 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c" returned: 0 in 0.479s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4835c9fc-27e1-43ce-9c1c-9e1f4d995f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e94059-a986-4829-87d3-d6b030a3fd6c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c20226-15bb-4fa0-b924-a22d26e5ef15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:37 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Volume volume-c5e94059-a986-4829-87d3-d6b030a3fd6c (c5e94059-a986-4829-87d3-d6b030a3fd6c): created successfully Sep 01 02:05:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c20226-15bb-4fa0-b924-a22d26e5ef15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Flow 'volume_create_manager' (9b6b9cc1-24f7-4a0d-9ff1-5f8885c79662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:38 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ec99d73c-dec0-4ed1-a9ec-7198a494b2c8 tempest-GroupsV314Test-1347903368 None] Created volume successfully. Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:40 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Cloning volume c5e94059-a986-4829-87d3-d6b030a3fd6c to volume 2c4f1a9f-ab56-42fd-9c00-024336027e8c Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Creating offline snapshot 6d49d2c5-1474-4253-a3e7-07f37b417eb7 of volume c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a452dbb5-3cf3-4bc2-969d-feed811099e1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:40 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c Sep 01 02:05:40 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:40 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Flow 'volume_create_manager' (3f020e65-11e0-47b8-a724-9c7c319a322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56950eb3-62a7-457e-b4b6-4f8f546c53ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c" returned: 0 in 0.597s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56950eb3-62a7-457e-b4b6-4f8f546c53ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d150a8-3d91-4811-b40f-8254e680687d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557c6dbb5ba5472394a7aedd68fd261f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:41Z,use_quota=True,user_id='ca73b78e52d54306b4554ee89f2d191c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4668eab-b329-4988-b8ac-4e5430e20007),volume_type_id=a4668eab-b329-4988-b8ac-4e5430e20007)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c364d314-dba7-4fe6-9ba1-27f4233bd528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c364d314-dba7-4fe6-9ba1-27f4233bd528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:40 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 1G Sep 01 02:05:40 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5796e1d-ea4b-4335-97f9-cf72f19f92d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:40 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5796e1d-ea4b-4335-97f9-cf72f19f92d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19d150a8-3d91-4811-b40f-8254e680687d', 'volume_name': 'volume-19d150a8-3d91-4811-b40f-8254e680687d', 'volume_size': 1, 'image_id': '66e5af48-8c02-4855-9c99-98e9b6a574bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66e5af48-8c02-4855-9c99-98e9b6a574bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6e93a7eff05681df599651d8b33dcbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '557c6dbb5ba5472394a7aedd68fd261f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ef500e0dd74e324c76dd23dcf2f3931ef673b577b1771f488ab99b1f8381f7a0bcc0d5cb4f7877de3726708f933fc502450c15dbbe608305a06425bcb2b4c19', 'id': '66e5af48-8c02-4855-9c99-98e9b6a574bc', 'created_at': datetime.datetime(2026, 9, 1, 0, 5, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 5, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66e5af48-8c02-4855-9c99-98e9b6a574bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55b04bc-a388-4f68-a69d-6c2531be6f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55b04bc-a388-4f68-a69d-6c2531be6f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7e9640-f0c9-4a80-9d42-d707e795e9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:41 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Volume 19d150a8-3d91-4811-b40f-8254e680687d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19d150a8-3d91-4811-b40f-8254e680687d', 'volume_size': 1, 'image_id': '66e5af48-8c02-4855-9c99-98e9b6a574bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66e5af48-8c02-4855-9c99-98e9b6a574bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6e93a7eff05681df599651d8b33dcbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '557c6dbb5ba5472394a7aedd68fd261f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ef500e0dd74e324c76dd23dcf2f3931ef673b577b1771f488ab99b1f8381f7a0bcc0d5cb4f7877de3726708f933fc502450c15dbbe608305a06425bcb2b4c19', 'id': '66e5af48-8c02-4855-9c99-98e9b6a574bc', 'created_at': datetime.datetime(2026, 9, 1, 0, 5, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 5, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66e5af48-8c02-4855-9c99-98e9b6a574bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Trying to clone 19d150a8-3d91-4811-b40f-8254e680687d from image 66e5af48-8c02-4855-9c99-98e9b6a574bc at location (None, [{'url': 'file:///opt/stack/data/glance/images/66e5af48-8c02-4855-9c99-98e9b6a574bc', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:05:41 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:05:41 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 1G" returned: 0 in 0.718s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e94059-a986-4829-87d3-d6b030a3fd6c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c4b545-3d2e-49f0-82a2-4f6881f8eab8]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:41 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e94059-a986-4829-87d3-d6b030a3fd6c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 Sep 01 02:05:41 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:41 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD Sep 01 02:05:41 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:42 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e94059-a986-4829-87d3-d6b030a3fd6c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7" returned: 0 in 0.654s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:42 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:42 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD" returned: 0 in 0.667s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:42 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 Sep 01 02:05:42 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:42 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD Sep 01 02:05:42 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:42 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7" returned: 0 in 0.427s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:42 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD" returned: 1 in 0.481s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Temporary image 66e5af48-8c02-4855-9c99-98e9b6a574bc is fetched for user ca73b78e52d54306b4554ee89f2d191c. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:05:42 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.info Sep 01 02:05:42 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14c7285-14b1-4dc0-a45f-d8c06937b81c]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:42 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD Sep 01 02:05:42 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:43 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.info" returned: 0 in 0.536s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:43 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:43 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.info Sep 01 02:05:43 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:43 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD" returned: 0 in 0.507s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:43 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD Sep 01 02:05:43 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:43 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.info" returned: 0 in 0.312s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Acquiring lock "cinder-quobyte-2c4f1a9f-ab56-42fd-9c00-024336027e8c" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Lock "cinder-quobyte-2c4f1a9f-ab56-42fd-9c00-024336027e8c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] snapshot: 6d49d2c5-1474-4253-a3e7-07f37b417eb7, volume: 2c4f1a9f-ab56-42fd-9c00-024336027e8c, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ae58fe-84c5-468e-89bb-be342e9aed7a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:43 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:43 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 Sep 01 02:05:43 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:43 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7" returned: 0 in 0.429s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e94059-a986-4829-87d3-d6b030a3fd6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b80985-4fa3-48b6-98e7-0b04dcedcdb6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:44 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c Sep 01 02:05:44 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:44 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c" returned: 0 in 0.413s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:05:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:05:44 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:05:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:44 devstack sudo[93707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c Sep 01 02:05:44 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:49 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c" returned: 0 in 5.330s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:49 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:05:49 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Converted 1024.00 MB image at 192.06 MB/s Sep 01 02:05:49 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:05:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:49 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c Sep 01 02:05:49 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:50 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c" returned: 0 in 0.327s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Lock "cinder-quobyte-2c4f1a9f-ab56-42fd-9c00-024336027e8c" released by "_copy_volume_from_snapshot" :: held 6.607s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Acquiring lock "cinder-quobyte-6d49d2c5-1474-4253-a3e7-07f37b417eb7" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Lock "cinder-quobyte-6d49d2c5-1474-4253-a3e7-07f37b417eb7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Deleting offline snapshot 6d49d2c5-1474-4253-a3e7-07f37b417eb7 of volume c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] snapshot_file for this snap is: volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2137ba-8353-42aa-818a-4ac04854234c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:50 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 Sep 01 02:05:50 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:50 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7" returned: 0 in 0.470s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e94059-a986-4829-87d3-d6b030a3fd6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc69a7ec-27af-4f62-9437-8bf5a8c34e21]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:50 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c Sep 01 02:05:50 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:51 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c" returned: 0 in 0.652s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:51 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 Sep 01 02:05:51 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:51 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7" returned: 0 in 0.472s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:51 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7 Sep 01 02:05:51 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:52 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c.6d49d2c5-1474-4253-a3e7-07f37b417eb7" returned: 0 in 0.284s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Lock "cinder-quobyte-6d49d2c5-1474-4253-a3e7-07f37b417eb7" released by "_delete_snapshot" :: held 2.022s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.171s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.535s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19d150a8-3d91-4811-b40f-8254e680687d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557c6dbb5ba5472394a7aedd68fd261f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:41Z,use_quota=True,user_id='ca73b78e52d54306b4554ee89f2d191c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4668eab-b329-4988-b8ac-4e5430e20007),volume_type_id=a4668eab-b329-4988-b8ac-4e5430e20007)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Creating volume 19d150a8-3d91-4811-b40f-8254e680687d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:52 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:52 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d 1073741824 Sep 01 02:05:52 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e57d1353-6ff3-4e67-b9cf-1caa1a985531 tempest-GroupsV314Test-1347903368 None] Create group from source-group-1a7b398d-3bc0-4f0d-9ddb-6c409eb84525 completed successfully. Sep 01 02:05:52 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d 1073741824" returned: 0 in 0.566s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:52 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d Sep 01 02:05:52 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Acquiring lock "cinder-quobyte-2c4f1a9f-ab56-42fd-9c00-024336027e8c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Lock "cinder-quobyte-2c4f1a9f-ab56-42fd-9c00-024336027e8c" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fde610-aa1d-4cbc-826d-26c399df2db5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:53 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d" returned: 0 in 0.387s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Attempting download of 66e5af48-8c02-4855-9c99-98e9b6a574bc ((None, [{'url': 'file:///opt/stack/data/glance/images/66e5af48-8c02-4855-9c99-98e9b6a574bc', 'metadata': {}}])) to volume 19d150a8-3d91-4811-b40f-8254e680687d. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:05:53 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c Sep 01 02:05:53 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[956391c9-24fd-4772-a68d-747a05a02d19]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66e5af48-8c02-4855-9c99-98e9b6a574bc_u8avfl99 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:53 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66e5af48-8c02-4855-9c99-98e9b6a574bc_u8avfl99 Sep 01 02:05:53 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:53 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c" returned: 0 in 0.563s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:53 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c Sep 01 02:05:53 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:53 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66e5af48-8c02-4855-9c99-98e9b6a574bc_u8avfl99" returned: 0 in 0.438s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66e5af48-8c02-4855-9c99-98e9b6a574bc_u8avfl99 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:53 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66e5af48-8c02-4855-9c99-98e9b6a574bc_u8avfl99 Sep 01 02:05:53 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:54 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2c4f1a9f-ab56-42fd-9c00-024336027e8c" returned: 0 in 0.374s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Lock "cinder-quobyte-2c4f1a9f-ab56-42fd-9c00-024336027e8c" released by "delete_volume" :: held 1.002s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Created reservations ['5a26b651-b7bc-4cd5-b5ff-ff8d6fb5b3f4'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:54 devstack cinder-volume[87425]: WARNING cinder.quota [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2077195341 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2077195341, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:05:54 devstack cinder-volume[87425]: WARNING cinder.quota [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2077195341 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2077195341, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Created reservations ['1c6229ce-8160-4c6a-b193-0636162a0a64', 'cca40bad-b640-4bff-bdd5-d4f1fd6b2dfc', 'aec7d77f-ed9a-4e19-9a62-807e2dab7833', 'db1a77e6-31a7-41cf-abe7-d2dd1eb978b2'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:54 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66e5af48-8c02-4855-9c99-98e9b6a574bc_u8avfl99" returned: 1 in 0.506s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66e5af48-8c02-4855-9c99-98e9b6a574bc_u8avfl99' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfb4e81-3627-4c2d-b66b-ccc44a21f723]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:54 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD Sep 01 02:05:54 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:54 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:54 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:54 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:55 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.593s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:55 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6cd01708-2a8f-4a0d-b38c-cb684aeb1cab tempest-GroupsV314Test-1347903368 None] Delete group completed successfully. Sep 01 02:05:55 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD Sep 01 02:05:55 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:55 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD" returned: 1 in 0.549s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:05:55 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] 66e5af48-8c02-4855-9c99-98e9b6a574bc was raw, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:05:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:55 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d Sep 01 02:05:55 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Acquiring lock "cinder-quobyte-c5e94059-a986-4829-87d3-d6b030a3fd6c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Lock "cinder-quobyte-c5e94059-a986-4829-87d3-d6b030a3fd6c" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a8d094-5033-4082-b753-f704120a0b9d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:56 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d" returned: 0 in 0.739s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_66e5af48-8c02-4855-9c99-98e9b6a574bc_484glw7ndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:05:56 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:56 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c Sep 01 02:05:56 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:56 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d 1G Sep 01 02:05:56 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:56 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c" returned: 0 in 0.605s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:56 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d 1G" returned: 0 in 0.483s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:56 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c Sep 01 02:05:56 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Downloaded image 66e5af48-8c02-4855-9c99-98e9b6a574bc ((None, [{'url': 'file:///opt/stack/data/glance/images/66e5af48-8c02-4855-9c99-98e9b6a574bc', 'metadata': {}}])) to volume 19d150a8-3d91-4811-b40f-8254e680687d successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Temporary image 66e5af48-8c02-4855-9c99-98e9b6a574bc for user ca73b78e52d54306b4554ee89f2d191c is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Marking volume 19d150a8-3d91-4811-b40f-8254e680687d as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Copying metadata from image 66e5af48-8c02-4855-9c99-98e9b6a574bc to 19d150a8-3d91-4811-b40f-8254e680687d. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Creating volume glance metadata for volume 19d150a8-3d91-4811-b40f-8254e680687d backed by image 66e5af48-8c02-4855-9c99-98e9b6a574bc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '66e5af48-8c02-4855-9c99-98e9b6a574bc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd6e93a7eff05681df599651d8b33dcbf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e7e9640-f0c9-4a80-9d42-d707e795e9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19d150a8-3d91-4811-b40f-8254e680687d', 'volume_size': 1, 'image_id': '66e5af48-8c02-4855-9c99-98e9b6a574bc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66e5af48-8c02-4855-9c99-98e9b6a574bc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd6e93a7eff05681df599651d8b33dcbf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '557c6dbb5ba5472394a7aedd68fd261f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ef500e0dd74e324c76dd23dcf2f3931ef673b577b1771f488ab99b1f8381f7a0bcc0d5cb4f7877de3726708f933fc502450c15dbbe608305a06425bcb2b4c19', 'id': '66e5af48-8c02-4855-9c99-98e9b6a574bc', 'created_at': datetime.datetime(2026, 9, 1, 0, 5, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 5, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66e5af48-8c02-4855-9c99-98e9b6a574bc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e96c181-e5e0-4857-b12d-7879999a6d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Volume volume-19d150a8-3d91-4811-b40f-8254e680687d (19d150a8-3d91-4811-b40f-8254e680687d): created successfully Sep 01 02:05:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e96c181-e5e0-4857-b12d-7879999a6d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Flow 'volume_create_manager' (3f020e65-11e0-47b8-a724-9c7c319a322e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-89e78705-7361-4876-a1f5-638d4b74cfcb tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Created volume successfully. Sep 01 02:05:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-920c4fd1-cf69-4734-abd0-52523e61358d req-d993679a-86d0-42e5-b365-3ba2e9a4e78d tempest-ServerActionsTestOtherA-1855892746 None] Terminate volume connection completed successfully. Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-920c4fd1-cf69-4734-abd0-52523e61358d req-d993679a-86d0-42e5-b365-3ba2e9a4e78d tempest-ServerActionsTestOtherA-1855892746 None] Deleting attachment 754e1e5b-06aa-47f8-a14c-b935abd5299b. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:57 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c5e94059-a986-4829-87d3-d6b030a3fd6c" returned: 0 in 0.452s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Lock "cinder-quobyte-c5e94059-a986-4829-87d3-d6b030a3fd6c" released by "delete_volume" :: held 1.155s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "cinder-2b20aaea-3996-4d56-8ed0-8c74620ba15d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Lock "cinder-2b20aaea-3996-4d56-8ed0-8c74620ba15d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Created reservations ['27a9462b-1006-4316-9363-715404a9e3ed'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "cinder-quobyte-2b20aaea-3996-4d56-8ed0-8c74620ba15d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Lock "cinder-quobyte-2b20aaea-3996-4d56-8ed0-8c74620ba15d" acquired by "delete_volume" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[017205fa-6f51-4d73-9ddd-295bfc61c811]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Created reservations ['011468e0-36f3-4524-b397-b0137155a64d', 'ffd90aa2-296c-418d-8678-a669accd9812', 'e132f43e-aa15-411c-8458-67f01a0e92fe', '98a85bbc-6b7c-44b6-a92c-58f6afc7c910'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Acquiring lock "cinder-19d150a8-3d91-4811-b40f-8254e680687d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "cinder-19d150a8-3d91-4811-b40f-8254e680687d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:57 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d Sep 01 02:05:57 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Acquiring lock "cinder-quobyte-19d150a8-3d91-4811-b40f-8254e680687d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "cinder-quobyte-19d150a8-3d91-4811-b40f-8254e680687d" acquired by "delete_volume" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1149c3a-34ae-463f-af4e-ce951e22e10a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:57 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:57 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:58 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d Sep 01 02:05:58 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:58 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d" returned: 0 in 0.646s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:58 devstack sudo[93848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d Sep 01 02:05:58 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:58 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.398s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:58 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1343b34c-07ec-4f48-a9a0-41afd3979da7 tempest-GroupsV314Test-1347903368 None] Delete group completed successfully. Sep 01 02:05:58 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d" returned: 0 in 0.548s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:58 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d Sep 01 02:05:58 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "cinder-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:58 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2b20aaea-3996-4d56-8ed0-8c74620ba15d" returned: 0 in 0.432s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Lock "cinder-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Lock "cinder-quobyte-2b20aaea-3996-4d56-8ed0-8c74620ba15d" released by "delete_volume" :: held 1.195s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "cinder-quobyte-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Lock "cinder-quobyte-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.quota [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Created reservations ['64842aed-5c4d-43f9-b7a3-098bc01cc35f', 'e9de2c04-dff0-463c-b202-721d31359415', 'c329b5aa-748f-4b4c-8a02-cf3f2d91c73e', 'd97ec10b-eb7e-42cc-90e5-42ef8db31d0b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b63896-d80a-4478-a54d-2d644dbe9245]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:58 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 Sep 01 02:05:58 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:58 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:58 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:58 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:58 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Flow 'volume_create_manager' (0327aa6a-9f0b-4c7a-bbdb-e11555ff017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c0881d-2fde-4ad7-956c-de224e8579ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-19d150a8-3d91-4811-b40f-8254e680687d" returned: 0 in 0.616s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3c0881d-2fde-4ad7-956c-de224e8579ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-474088994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8425132a524940a5b72ba3de22856ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:59Z,use_quota=True,user_id='b5f65d12ee2a4014af0dcd6f6544d7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1ebccb-b551-4b2f-925a-5b82dce3cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1ebccb-b551-4b2f-925a-5b82dce3cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c9d378-d420-4f3a-8e2a-0bec13c0da1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c9d378-d420-4f3a-8e2a-0bec13c0da1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee', 'volume_name': 'volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077f1e01-becf-4f29-88d8-98bf5788f01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077f1e01-becf-4f29-88d8-98bf5788f01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2d7e4a-ff67-49a6-8e41-7bccbc770b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Volume c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee', 'volume_size': 1} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-474088994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8425132a524940a5b72ba3de22856ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:59Z,use_quota=True,user_id='b5f65d12ee2a4014af0dcd6f6544d7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Creating volume c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:59 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "cinder-quobyte-19d150a8-3d91-4811-b40f-8254e680687d" released by "delete_volume" :: held 1.376s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:59 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee 1073741824 Sep 01 02:05:59 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:59 devstack cinder-volume[87425]: WARNING cinder.quota [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:05:59 devstack cinder-volume[87425]: WARNING cinder.quota [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Created reservations ['5d43b88a-c3f4-4eb0-90a3-5c5779f13ff5', '7136f8c6-d812-4eba-83ac-9a9a1474a367', 'e56ca328-cd4c-4f97-926d-bef45c14d954', '3a1d51ea-aca6-4038-8106-184fadf2f671'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:59 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.310s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.manager [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Deleted volume successfully. Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-920c4fd1-cf69-4734-abd0-52523e61358d req-38624550-deb8-41f5-a887-16563d08417c tempest-ServerActionsTestOtherA-1855892746 None] Lock "cinder-2b20aaea-3996-4d56-8ed0-8c74620ba15d-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:59 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52" returned: 0 in 0.526s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:59 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52 Sep 01 02:05:59 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:59 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:05:59 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:59 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52" returned: 0 in 0.317s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Lock "cinder-quobyte-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52" released by "delete_volume" :: held 0.922s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:59 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.329s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Deleted volume successfully. Sep 01 02:05:59 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e3df76f5-8970-4fb4-9559-17c08d343662 tempest-VolumeAndVolumeTypeFromImageTest-692695827 None] Lock "cinder-19d150a8-3d91-4811-b40f-8254e680687d-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee 1073741824" returned: 0 in 0.651s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Created reservations ['9d088e9a-fa22-4123-96d3-c4cf9a838220', '5b920fc0-3729-45f6-8e38-ba63500cbccd', '6bb741bd-d074-4da6-a1f1-06115d97b878', 'd9b816ca-f4d4-4c5d-a4b7-266fcebb0be2'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:59 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee Sep 01 02:05:59 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:00 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:00 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:00 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee" returned: 0 in 0.433s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca2d7e4a-ff67-49a6-8e41-7bccbc770b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac7d29c-af10-4171-81ee-4522a1d89f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:00 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Volume volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee (c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee): created successfully Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac7d29c-af10-4171-81ee-4522a1d89f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Flow 'volume_create_manager' (0327aa6a-9f0b-4c7a-bbdb-e11555ff017d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-74ad7e3b-db0a-42ea-82cb-f2c0c8b94ca3 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Created volume successfully. Sep 01 02:06:00 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.398s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Deleted volume successfully. Sep 01 02:06:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5b45163a-8f87-466f-9fe1-4dc8bb73af30 tempest-ServerActionsTestOtherA-1855892746 None] Lock "cinder-98561eaf-ef3d-4f0f-8fb2-68bd924bfa52-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Acquiring lock "cinder-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "cinder-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Acquiring lock "cinder-quobyte-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "cinder-quobyte-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:02 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15d83c-6e5f-4b71-8678-733d514a7f89]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:02 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee Sep 01 02:06:02 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:03 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee" returned: 0 in 0.472s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:03 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee Sep 01 02:06:03 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:03 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee" returned: 0 in 0.399s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "cinder-quobyte-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee" released by "delete_volume" :: held 0.954s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Created reservations ['8e4ffd80-4ad4-4047-804e-6a7c5bb40541', 'c6724c37-2268-478c-838d-15102a148002', '747fb219-9ad5-4278-a9b7-3693da6d6a3a', '3e056cca-da17-4499-8389-3432308042f9'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:04 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:04 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:04 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:04 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:04 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Deleted volume successfully. Sep 01 02:06:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e6abc7e-f67e-4c07-8e1d-5a10c6a93985 tempest-VolumeQuotasNegativeTestJSON-960555887 None] Lock "cinder-c12b8c7b-9397-4b1f-897c-fe0d9c9d90ee-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:06 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:06 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:06 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.321s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:06:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (fb99832d-3d68-44e2-99e9-1a4f943bc9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f631d420-1856-4229-8b49-b1d15a248611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f631d420-1856-4229-8b49-b1d15a248611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715037881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcdd960-8b5f-45b9-bc50-172132bb8388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:08Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be760cb7-f0c0-4266-8434-4172ca240aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be760cb7-f0c0-4266-8434-4172ca240aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edee0e45-d113-4e6f-95ac-91c44123ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edee0e45-d113-4e6f-95ac-91c44123ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcdd960-8b5f-45b9-bc50-172132bb8388', 'volume_name': 'volume-6fcdd960-8b5f-45b9-bc50-172132bb8388', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d316634-8f36-45e4-98ce-981dc4ef5384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d316634-8f36-45e4-98ce-981dc4ef5384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b984e472-56e9-42cc-96f5-4a425599530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Volume 6fcdd960-8b5f-45b9-bc50-172132bb8388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcdd960-8b5f-45b9-bc50-172132bb8388', 'volume_size': 1} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715037881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcdd960-8b5f-45b9-bc50-172132bb8388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:08Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Creating volume 6fcdd960-8b5f-45b9-bc50-172132bb8388 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:08 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:08 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 1073741824 Sep 01 02:06:08 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:09 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 1073741824" returned: 0 in 0.834s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 Sep 01 02:06:09 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (a8db88ac-8e3e-4bdf-b0a1-6432ea0509d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741beeea-0eef-406b-b62d-ccd308bce346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741beeea-0eef-406b-b62d-ccd308bce346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-860056967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49304a15-3638-4b00-933c-2aa1afd2df06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:09Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ed9f4f-bca3-438e-9923-81f3df0d6745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ed9f4f-bca3-438e-9923-81f3df0d6745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510c8417-b162-460c-8dff-0b8cc34f8a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510c8417-b162-460c-8dff-0b8cc34f8a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49304a15-3638-4b00-933c-2aa1afd2df06', 'volume_name': 'volume-49304a15-3638-4b00-933c-2aa1afd2df06', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2306857-19c7-4977-a9d3-3309f7c36d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2306857-19c7-4977-a9d3-3309f7c36d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e741b6-f99a-47a9-8432-62ab407d9bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Volume 49304a15-3638-4b00-933c-2aa1afd2df06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49304a15-3638-4b00-933c-2aa1afd2df06', 'volume_size': 1} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:09 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388" returned: 0 in 0.562s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-860056967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49304a15-3638-4b00-933c-2aa1afd2df06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:09Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Creating volume 49304a15-3638-4b00-933c-2aa1afd2df06 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:09 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 1073741824 Sep 01 02:06:09 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b984e472-56e9-42cc-96f5-4a425599530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcdd960-8b5f-45b9-bc50-172132bb8388', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6477e825-5868-45d5-b209-ae0671ae6f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:10 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Volume volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 (6fcdd960-8b5f-45b9-bc50-172132bb8388): created successfully Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6477e825-5868-45d5-b209-ae0671ae6f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (fb99832d-3d68-44e2-99e9-1a4f943bc9c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (20105778-0fd3-46d0-a90c-b92ea308a992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a112bc-b477-43fe-9514-38a0876a4849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ca5c3d75-dbcb-4988-905b-763e0af9610f tempest-CreateVolumesFromImageTest-186103360 None] Created volume successfully. Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a112bc-b477-43fe-9514-38a0876a4849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047490396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd9f792-0a2e-43bb-8d8c-48d06448dc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:10Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31aa736-bf1c-4ba7-9caf-bbc8aef38609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31aa736-bf1c-4ba7-9caf-bbc8aef38609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06fd0ba-1b60-4e35-8211-d3328fb27f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06fd0ba-1b60-4e35-8211-d3328fb27f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd9f792-0a2e-43bb-8d8c-48d06448dc88', 'volume_name': 'volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490688d0-509e-4e45-a76d-fcff54f5228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490688d0-509e-4e45-a76d-fcff54f5228a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256675a1-9b8a-4de5-bddc-9f76deb6a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:10 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Volume fdd9f792-0a2e-43bb-8d8c-48d06448dc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88', 'volume_size': 1} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:10 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 1073741824" returned: 0 in 0.738s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:10 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 Sep 01 02:06:10 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (4294630f-0afa-4e71-82ae-2f0bcc93011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a24df2-0154-4c07-8c42-7cebb8a3170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a24df2-0154-4c07-8c42-7cebb8a3170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2050152284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995246a7-fc92-4fd9-9e96-788cc372e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:11Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aff31d4-2997-4c39-9b39-108754445b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aff31d4-2997-4c39-9b39-108754445b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cde165b-4dfc-444b-a4a1-0c1b0b7f3712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cde165b-4dfc-444b-a4a1-0c1b0b7f3712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '995246a7-fc92-4fd9-9e96-788cc372e567', 'volume_name': 'volume-995246a7-fc92-4fd9-9e96-788cc372e567', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ca0e1d-58c3-42d1-ae9f-c9f2e554ea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ca0e1d-58c3-42d1-ae9f-c9f2e554ea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7da01e2-c0cd-4a68-8a3d-cfa68fe18186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Volume 995246a7-fc92-4fd9-9e96-788cc372e567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-995246a7-fc92-4fd9-9e96-788cc372e567', 'volume_size': 1} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06" returned: 0 in 0.696s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:11 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1047490396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd9f792-0a2e-43bb-8d8c-48d06448dc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:10Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Creating volume fdd9f792-0a2e-43bb-8d8c-48d06448dc88 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:11 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e741b6-f99a-47a9-8432-62ab407d9bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49304a15-3638-4b00-933c-2aa1afd2df06', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e07b60-a4d5-4c2e-9bb3-3d0b75a51bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack sudo[93950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 1073741824 Sep 01 02:06:11 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:11 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Volume volume-49304a15-3638-4b00-933c-2aa1afd2df06 (49304a15-3638-4b00-933c-2aa1afd2df06): created successfully Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e07b60-a4d5-4c2e-9bb3-3d0b75a51bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (a8db88ac-8e3e-4bdf-b0a1-6432ea0509d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-71567397-d50c-432b-9a21-222d2c22e3cd tempest-CreateVolumesFromImageTest-186103360 None] Created volume successfully. Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (428279fa-cbc2-4be2-bb23-b6aa4f903b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccaf799-0658-47ef-8f93-6752b98d0825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eccaf799-0658-47ef-8f93-6752b98d0825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-178493080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45685fe5-53c6-40bf-8b15-bc7045b09867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:12Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79aa123-40c4-4251-9858-99cb8b571f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79aa123-40c4-4251-9858-99cb8b571f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d037ae-5ddf-40ea-80e7-840dc6192e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d037ae-5ddf-40ea-80e7-840dc6192e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45685fe5-53c6-40bf-8b15-bc7045b09867', 'volume_name': 'volume-45685fe5-53c6-40bf-8b15-bc7045b09867', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205ff44c-8ec4-4c24-8cdd-648b3993e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (205ff44c-8ec4-4c24-8cdd-648b3993e71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb1b5bd-c8b7-4043-a52e-58a87b8350e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:11 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Volume 45685fe5-53c6-40bf-8b15-bc7045b09867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45685fe5-53c6-40bf-8b15-bc7045b09867', 'volume_size': 1} Sep 01 02:06:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:12 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 1073741824" returned: 0 in 0.750s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:12 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 Sep 01 02:06:12 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:12 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88" returned: 0 in 0.319s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.484s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2050152284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995246a7-fc92-4fd9-9e96-788cc372e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:11Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Creating volume 995246a7-fc92-4fd9-9e96-788cc372e567 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:12 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256675a1-9b8a-4de5-bddc-9f76deb6a89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0051b789-adc8-417a-8470-3ed380b8fbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:12 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 1073741824 Sep 01 02:06:12 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:12 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Volume volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 (fdd9f792-0a2e-43bb-8d8c-48d06448dc88): created successfully Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0051b789-adc8-417a-8470-3ed380b8fbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (20105778-0fd3-46d0-a90c-b92ea308a992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:12 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5745460f-0e87-41d9-a34e-76ada5148690 tempest-CreateVolumesFromImageTest-186103360 None] Created volume successfully. Sep 01 02:06:13 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 1073741824" returned: 0 in 0.871s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:13 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 Sep 01 02:06:13 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:13 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567" returned: 0 in 0.338s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.946s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-178493080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45685fe5-53c6-40bf-8b15-bc7045b09867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26651500935c423281a3b9541785b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:12Z,use_quota=True,user_id='6ec186bc8014477d96d737581fc14049',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Creating volume 45685fe5-53c6-40bf-8b15-bc7045b09867 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:13 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7da01e2-c0cd-4a68-8a3d-cfa68fe18186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-995246a7-fc92-4fd9-9e96-788cc372e567', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:13 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 1073741824 Sep 01 02:06:13 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e4e0e1-42c9-44bc-a9e8-fad7aec010b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:14 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Volume volume-995246a7-fc92-4fd9-9e96-788cc372e567 (995246a7-fc92-4fd9-9e96-788cc372e567): created successfully Sep 01 02:06:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e4e0e1-42c9-44bc-a9e8-fad7aec010b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (4294630f-0afa-4e71-82ae-2f0bcc93011d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b7f69dee-f7ef-49f7-bd16-cca0891a0599 tempest-CreateVolumesFromImageTest-186103360 None] Created volume successfully. Sep 01 02:06:14 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 1073741824" returned: 0 in 0.708s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:14 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 Sep 01 02:06:14 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:15 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867" returned: 0 in 0.354s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb1b5bd-c8b7-4043-a52e-58a87b8350e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45685fe5-53c6-40bf-8b15-bc7045b09867', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68040688-d07e-4a3b-b84f-b0b978dd923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:15 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Volume volume-45685fe5-53c6-40bf-8b15-bc7045b09867 (45685fe5-53c6-40bf-8b15-bc7045b09867): created successfully Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68040688-d07e-4a3b-b84f-b0b978dd923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Flow 'volume_create_manager' (428279fa-cbc2-4be2-bb23-b6aa4f903b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8afafe68-bb65-4d2e-a8b7-68517d36a5fa tempest-CreateVolumesFromImageTest-186103360 None] Created volume successfully. Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-45685fe5-53c6-40bf-8b15-bc7045b09867-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-45685fe5-53c6-40bf-8b15-bc7045b09867-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-quobyte-45685fe5-53c6-40bf-8b15-bc7045b09867" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-45685fe5-53c6-40bf-8b15-bc7045b09867" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f2e0c3-a5db-4040-a6dc-ed7ec8840a7c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Flow 'volume_create_manager' (943b7bf8-1260-4724-949d-de0ceeac3ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7831ef-0516-418b-a157-dfb633ed59f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7831ef-0516-418b-a157-dfb633ed59f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2018702646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359041d4-ff5e-4289-a7f1-54c7f395b1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5415781147614ea2a21170ae23193f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:16Z,use_quota=True,user_id='2e020b86e76a4a7692173cb9e868c8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28902e20-f613-47d5-95e7-c9ec3455c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28902e20-f613-47d5-95e7-c9ec3455c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b56e9f-676c-471f-afd7-e6d3c288a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b56e9f-676c-471f-afd7-e6d3c288a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359041d4-ff5e-4289-a7f1-54c7f395b1f4', 'volume_name': 'volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3cc388b-42d8-44a9-973a-0f4fccb0a00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3cc388b-42d8-44a9-973a-0f4fccb0a00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f11de9-b2c5-4fef-800a-989f854aecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:15 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Volume 359041d4-ff5e-4289-a7f1-54c7f395b1f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4', 'volume_size': 1} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2018702646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359041d4-ff5e-4289-a7f1-54c7f395b1f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5415781147614ea2a21170ae23193f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:16Z,use_quota=True,user_id='2e020b86e76a4a7692173cb9e868c8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Creating volume 359041d4-ff5e-4289-a7f1-54c7f395b1f4 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:15 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 Sep 01 02:06:15 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:15 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:15 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 1073741824 Sep 01 02:06:15 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:16 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867" returned: 0 in 0.506s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867 Sep 01 02:06:16 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:16 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 1073741824" returned: 0 in 0.699s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:16 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-45685fe5-53c6-40bf-8b15-bc7045b09867" returned: 0 in 0.380s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-45685fe5-53c6-40bf-8b15-bc7045b09867" released by "delete_volume" :: held 0.971s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 Sep 01 02:06:16 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Created reservations ['7bb72e59-1d82-4da3-9388-020c4c6f336c', '729dde98-5278-41f7-b422-d5c7f95555e6', '8130a06e-249a-40ee-a5b0-e0e1504b7935', 'b746f650-391e-4712-9c9a-6a893e528d95'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:16 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:17 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4" returned: 0 in 0.444s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f11de9-b2c5-4fef-800a-989f854aecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7fdc68-bcce-4b64-9363-cd7b09fb7cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:17 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Volume volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 (359041d4-ff5e-4289-a7f1-54c7f395b1f4): created successfully Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f7fdc68-bcce-4b64-9363-cd7b09fb7cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Flow 'volume_create_manager' (943b7bf8-1260-4724-949d-de0ceeac3ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9ffa48fb-563d-4eec-9a3a-2669f33563ce tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Created volume successfully. Sep 01 02:06:17 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Deleted volume successfully. Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a0ed8266-b04d-4366-9a8c-10478659b992 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-45685fe5-53c6-40bf-8b15-bc7045b09867-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-995246a7-fc92-4fd9-9e96-788cc372e567-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-995246a7-fc92-4fd9-9e96-788cc372e567-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-quobyte-995246a7-fc92-4fd9-9e96-788cc372e567" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-995246a7-fc92-4fd9-9e96-788cc372e567" acquired by "delete_volume" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Creating offline snapshot 01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 of volume 359041d4-ff5e-4289-a7f1-54c7f395b1f4 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[0181c5ad-2fff-46e3-aefc-3a162dc9c94e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8984bfb-286f-4f6a-be2a-2f4ee66fb6be]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 Sep 01 02:06:18 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 Sep 01 02:06:18 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567" returned: 0 in 0.470s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567 Sep 01 02:06:18 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4" returned: 0 in 0.584s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:18 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 1G Sep 01 02:06:18 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-995246a7-fc92-4fd9-9e96-788cc372e567" returned: 0 in 0.343s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-995246a7-fc92-4fd9-9e96-788cc372e567" released by "delete_volume" :: held 0.877s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Created reservations ['f284fcac-99b0-4355-bd2d-a661ab4fbfc8', 'becb015f-e533-4f08-b9ee-115bc8b31355', 'a4cad686-3074-41f5-98cb-f629dcbcc8c7', '3a6476bb-a543-4122-a04b-8ed6c43082b8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:19 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:19 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:19 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 1G" returned: 0 in 0.615s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:19 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 Sep 01 02:06:19 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:19 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.304s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Deleted volume successfully. Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c765d526-eb8a-44db-bf6c-ff65d1303483 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-995246a7-fc92-4fd9-9e96-788cc372e567-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:19 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0" returned: 0 in 0.394s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:19 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 is being set with open permissions: ugo+rw Sep 01 02:06:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:19 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 Sep 01 02:06:19 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0" returned: 0 in 0.322s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.info Sep 01 02:06:20 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-fdd9f792-0a2e-43bb-8d8c-48d06448dc88-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-fdd9f792-0a2e-43bb-8d8c-48d06448dc88-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-quobyte-fdd9f792-0a2e-43bb-8d8c-48d06448dc88" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-fdd9f792-0a2e-43bb-8d8c-48d06448dc88" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceeb9a3-f512-4cbc-a626-b927434b7d28]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.info" returned: 0 in 0.413s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.info is being set with open permissions: ugo+rw Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.info Sep 01 02:06:20 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 Sep 01 02:06:20 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.info" returned: 0 in 0.324s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.813s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:20 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88" returned: 0 in 0.455s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:20 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88 Sep 01 02:06:20 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-bd7c134e-e8e2-443e-aa30-7610565223d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Create snapshot completed successfully Sep 01 02:06:21 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fdd9f792-0a2e-43bb-8d8c-48d06448dc88" returned: 0 in 0.358s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-fdd9f792-0a2e-43bb-8d8c-48d06448dc88" released by "delete_volume" :: held 0.871s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=124,cinder:SELECT=90,cinder:INSERT=39,cinder:DELETE=10 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Created reservations ['b7df2b17-c463-4de7-aa21-798b5c3d623b', '4573845f-2e87-4c67-b24f-3a8d2a5097f9', 'c2b53a81-c30c-4ca7-a72f-68ba83be0826', '202f34f2-e37a-418c-b689-0b60ea666999'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:21 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:21 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-49304a15-3638-4b00-933c-2aa1afd2df06-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-49304a15-3638-4b00-933c-2aa1afd2df06-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=114,cinder:INSERT=32,cinder:UPDATE=139,cinder:DELETE=9 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-quobyte-49304a15-3638-4b00-933c-2aa1afd2df06" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-49304a15-3638-4b00-933c-2aa1afd2df06" acquired by "delete_volume" :: waited 0.040s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca61e18-f29a-431e-9f73-d69193694d2f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:22 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 Sep 01 02:06:22 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:22 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.527s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Deleted volume successfully. Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b75224dd-fd65-4c50-990c-a54ae0896927 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-fdd9f792-0a2e-43bb-8d8c-48d06448dc88-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "cinder-01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "cinder-quobyte-359041d4-ff5e-4289-a7f1-54c7f395b1f4" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-quobyte-359041d4-ff5e-4289-a7f1-54c7f395b1f4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "cinder-quobyte-01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-quobyte-01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Deleting offline snapshot 01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 of volume 359041d4-ff5e-4289-a7f1-54c7f395b1f4 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] snapshot_file for this snap is: volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca8079-0387-430d-b9dd-e7e77ca7c442]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:22 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06" returned: 0 in 0.632s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:22 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 Sep 01 02:06:22 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:22 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06 Sep 01 02:06:22 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:22 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:22 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0" returned: 0 in 0.489s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-49304a15-3638-4b00-933c-2aa1afd2df06" returned: 0 in 0.429s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c2221-bea0-4c6e-b11f-1f5c9417c765]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-49304a15-3638-4b00-933c-2aa1afd2df06" released by "delete_volume" :: held 1.154s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:22 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Created reservations ['d0e1266e-257b-4a27-b821-8d69b9e86bf5', 'f2fc2241-a78a-41b6-b39f-608f7ccd1b45', 'f73bad85-7b02-40bf-af4f-bb43dbe10c40', '0b9b8249-7289-4b80-8b3b-afe2fec004b3'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:23 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 Sep 01 02:06:23 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:23 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:23 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:23 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4" returned: 0 in 0.518s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:23 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 Sep 01 02:06:23 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:23 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.381s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Deleted volume successfully. Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-48780bf8-bc10-402a-ab4c-879a0b2f00f3 tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-49304a15-3638-4b00-933c-2aa1afd2df06-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-6fcdd960-8b5f-45b9-bc50-172132bb8388-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-6fcdd960-8b5f-45b9-bc50-172132bb8388-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:24 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "cinder-quobyte-6fcdd960-8b5f-45b9-bc50-172132bb8388" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0" returned: 0 in 0.637s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-6fcdd960-8b5f-45b9-bc50-172132bb8388" acquired by "delete_volume" :: waited 0.042s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:24 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0 Sep 01 02:06:24 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b130997b-1467-4c4b-9f78-9bf58e7e5f95]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:24 devstack sudo[94076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 Sep 01 02:06:24 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:24 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4.01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0" returned: 0 in 0.470s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-quobyte-01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0" released by "_delete_snapshot" :: held 2.292s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-quobyte-359041d4-ff5e-4289-a7f1-54c7f395b1f4" released by "delete_snapshot" :: held 2.337s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:24 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388" returned: 0 in 0.480s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:24 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388 Sep 01 02:06:24 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Created reservations ['bde89a36-9603-449b-a795-909d1f1a42f2', '46b3a809-616d-4ebd-a9d1-dd0e6c07e376', 'bc8801e3-f61b-482a-99c0-0726f5d61cab', 'cce231f6-d29b-4e4e-853d-f79076e84dd2'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Delete snapshot completed successfully. Sep 01 02:06:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a9ff4332-aa1f-4f20-9d93-0cec5e89c965 tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-01b6f6b9-59c3-4f92-b0ed-0b4abb5efdd0-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:25 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6fcdd960-8b5f-45b9-bc50-172132bb8388" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-quobyte-6fcdd960-8b5f-45b9-bc50-172132bb8388" released by "delete_volume" :: held 0.940s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Created reservations ['8f1c6b2b-5c1f-4422-b532-6066c23d8af6', '35896777-54b9-4a84-99bd-f9ae05d3b839', 'a285033c-d237-4555-86fd-aff538b504ee', '81c17db9-db99-4ff4-83fc-fd6d1a871656'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:25 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:25 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:25 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.336s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Deleted volume successfully. Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8030aad7-ccfb-4b4f-bbce-1a8685d0f01b tempest-CreateVolumesFromImageTest-186103360 None] Lock "cinder-6fcdd960-8b5f-45b9-bc50-172132bb8388-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "cinder-359041d4-ff5e-4289-a7f1-54c7f395b1f4-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-359041d4-ff5e-4289-a7f1-54c7f395b1f4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "cinder-quobyte-359041d4-ff5e-4289-a7f1-54c7f395b1f4" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-quobyte-359041d4-ff5e-4289-a7f1-54c7f395b1f4" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8ab8c2-386e-4ed4-97ce-953ce5d4c5f7]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:25 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 Sep 01 02:06:25 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:26 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4" returned: 0 in 0.483s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:26 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4 Sep 01 02:06:26 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:26 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-359041d4-ff5e-4289-a7f1-54c7f395b1f4" returned: 0 in 0.348s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-quobyte-359041d4-ff5e-4289-a7f1-54c7f395b1f4" released by "delete_volume" :: held 0.928s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:26 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Created reservations ['ce7695ee-21b9-4fb1-aad3-21f498dab20d', 'bfa13239-179a-4887-a2c3-f0c36f366009', 'c0f9deae-6a0c-4b77-a977-3fbc99f30724', '59bafde9-e00c-485d-a064-d4a163b7a660'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:27 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:27 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:27 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.426s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Deleted volume successfully. Sep 01 02:06:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e7a8afd6-d87d-4fe3-8fc4-d2f70ce9d47a tempest-VolumeSnapshotQuotasNegativeTestJSON-240245291 None] Lock "cinder-359041d4-ff5e-4289-a7f1-54c7f395b1f4-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Flow 'volume_create_manager' (44e0cd89-86af-414a-95c6-cce8382dfb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62c0e9a-2935-4b8d-aaf1-f843e7e6612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62c0e9a-2935-4b8d-aaf1-f843e7e6612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-60056902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=205f11bf-d163-4d40-bea9-3453efb3b4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbbec82f51461f96b23a8a8af09839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:28Z,use_quota=True,user_id='d662b886870b47fc8ae38693a7b14851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c748b24-5642-40fb-968c-dd6707056778),volume_type_id=0c748b24-5642-40fb-968c-dd6707056778)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e740395-e7fc-4c1c-91b4-70a7b991c3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e740395-e7fc-4c1c-91b4-70a7b991c3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c484c36-3a9c-44a0-96ce-7842b77e98a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c484c36-3a9c-44a0-96ce-7842b77e98a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '205f11bf-d163-4d40-bea9-3453efb3b4a4', 'volume_name': 'volume-205f11bf-d163-4d40-bea9-3453efb3b4a4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e538611-340a-4fdb-bb95-893e668db01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e538611-340a-4fdb-bb95-893e668db01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783e929e-b79e-4502-9474-55bc20f439e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:28 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Volume 205f11bf-d163-4d40-bea9-3453efb3b4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-205f11bf-d163-4d40-bea9-3453efb3b4a4', 'volume_size': 1} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-60056902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=205f11bf-d163-4d40-bea9-3453efb3b4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbbec82f51461f96b23a8a8af09839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:28Z,use_quota=True,user_id='d662b886870b47fc8ae38693a7b14851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c748b24-5642-40fb-968c-dd6707056778),volume_type_id=0c748b24-5642-40fb-968c-dd6707056778)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Creating volume 205f11bf-d163-4d40-bea9-3453efb3b4a4 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:28 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:28 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 1073741824 Sep 01 02:06:28 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:29 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 1073741824" returned: 0 in 0.680s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:29 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 Sep 01 02:06:29 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:29 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4" returned: 0 in 0.379s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783e929e-b79e-4502-9474-55bc20f439e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-205f11bf-d163-4d40-bea9-3453efb3b4a4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51397a5f-9be5-4119-a669-e57abcdff27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:29 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Volume volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 (205f11bf-d163-4d40-bea9-3453efb3b4a4): created successfully Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51397a5f-9be5-4119-a669-e57abcdff27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Flow 'volume_create_manager' (44e0cd89-86af-414a-95c6-cce8382dfb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9f1b27c6-a6cb-4a1c-81bf-7627d03052e7 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Created volume successfully. Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:31 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:31 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:31 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.371s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f8dac4fa-cbb6-416e-b742-32bbe36703e6 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Retype volume completed successfully. Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (80593abd-3072-4a33-b77a-2892d7a14a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce125a54-c6d5-4c5f-8a0b-449607564ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce125a54-c6d5-4c5f-8a0b-449607564ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048704895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67151c1-ea49-41e2-ab68-a3c589fa2a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:32Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57363a98-5081-4d2a-ab24-644b448430c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57363a98-5081-4d2a-ab24-644b448430c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce17283b-56cc-431b-824c-642868a03b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce17283b-56cc-431b-824c-642868a03b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67151c1-ea49-41e2-ab68-a3c589fa2a2f', 'volume_name': 'volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d736eacd-8a88-4e58-aa30-b282092e70b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d736eacd-8a88-4e58-aa30-b282092e70b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3050ed9-6402-40d0-b1fd-f10e262e47bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:31 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume d67151c1-ea49-41e2-ab68-a3c589fa2a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f', 'volume_size': 1} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048704895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67151c1-ea49-41e2-ab68-a3c589fa2a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:32Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Creating volume d67151c1-ea49-41e2-ab68-a3c589fa2a2f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:31 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:31 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f 1073741824 Sep 01 02:06:31 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Acquiring lock "cinder-205f11bf-d163-4d40-bea9-3453efb3b4a4-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "cinder-205f11bf-d163-4d40-bea9-3453efb3b4a4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Acquiring lock "cinder-quobyte-205f11bf-d163-4d40-bea9-3453efb3b4a4" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "cinder-quobyte-205f11bf-d163-4d40-bea9-3453efb3b4a4" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5ca8c8-ca8d-4210-bc97-2b0bf3c44a09]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:32 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f 1073741824" returned: 0 in 0.910s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:32 devstack sudo[94119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f Sep 01 02:06:32 devstack sudo[94119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:32 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 Sep 01 02:06:32 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:33 devstack sudo[94119]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" returned: 0 in 0.432s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3050ed9-6402-40d0-b1fd-f10e262e47bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:33 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4f08b5-efb6-4170-a181-21afd5d65e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4" returned: 0 in 0.538s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:33 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f (d67151c1-ea49-41e2-ab68-a3c589fa2a2f): created successfully Sep 01 02:06:33 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4 Sep 01 02:06:33 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4f08b5-efb6-4170-a181-21afd5d65e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (80593abd-3072-4a33-b77a-2892d7a14a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:33 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f6cc7d9a-5f2a-4d20-8a40-e8a3fdecfc8f tempest-CreateVolumesFromSnapshotTest-117935991 None] Created volume successfully. Sep 01 02:06:33 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-205f11bf-d163-4d40-bea9-3453efb3b4a4" returned: 0 in 0.375s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "cinder-quobyte-205f11bf-d163-4d40-bea9-3453efb3b4a4" released by "delete_volume" :: held 1.005s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:33 devstack cinder-volume[87425]: WARNING cinder.quota [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:33 devstack cinder-volume[87425]: WARNING cinder.quota [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Created reservations ['ebe54fb0-272b-4a89-93d3-4537031ea05f', '2ecef18e-3249-4bb3-8bcc-0f2aabf140c5', '457f94ec-70be-47a8-ba8d-b483857f6e9d', 'c9e0febd-2186-4eb1-9051-3549c9e10c76'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:34 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Creating offline snapshot 4124a058-befb-4665-a620-73ea7631393f of volume d67151c1-ea49-41e2-ab68-a3c589fa2a2f {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e5d61d-fdd1-4fb9-a7f6-5cb5250dc0a3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f Sep 01 02:06:34 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:34 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.349s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Deleted volume successfully. Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5ae33b3a-2225-4d4a-bd05-be86b3253333 tempest-VolumeRetypeWithoutMigrationTest-1532821200 None] Lock "cinder-205f11bf-d163-4d40-bea9-3453efb3b4a4-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:34 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" returned: 0 in 0.484s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:34 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f 1G Sep 01 02:06:34 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:35 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f 1G" returned: 0 in 0.605s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:35 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f Sep 01 02:06:35 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:35 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f" returned: 0 in 0.445s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:35 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f is being set with open permissions: ugo+rw Sep 01 02:06:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:35 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f Sep 01 02:06:35 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:36 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f" returned: 0 in 0.535s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:36 devstack sudo[94187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.info Sep 01 02:06:36 devstack sudo[94187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:36 devstack sudo[94187]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.info" returned: 0 in 0.465s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:36 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.info is being set with open permissions: ugo+rw Sep 01 02:06:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:36 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.info Sep 01 02:06:36 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:37 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.info" returned: 0 in 0.366s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.090s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8118cc1d-e00e-47b5-b0d6-06f9ca6a1823 tempest-CreateVolumesFromSnapshotTest-117935991 None] Create snapshot completed successfully Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Flow 'volume_create_manager' (1a5ce497-3e2e-46d0-9d3f-b8a5e8b1daaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caf73bf-fbf9-40b8-8620-cbb54a7dd44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2caf73bf-fbf9-40b8-8620-cbb54a7dd44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1666811344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281d272e-4c39-435d-9866-814dd9f4e304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ca2e2b7b2447c1866d76052085a441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:39Z,use_quota=True,user_id='1358fbf1d5094a27a859c1f85ff2efaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba46f3d5-98fb-4cc2-b684-bf0443417270),volume_type_id=ba46f3d5-98fb-4cc2-b684-bf0443417270)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253e9972-a520-47b5-a082-b15c01f1e87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (253e9972-a520-47b5-a082-b15c01f1e87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc75d837-bd7b-42ae-bf04-9e46f859bf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc75d837-bd7b-42ae-bf04-9e46f859bf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281d272e-4c39-435d-9866-814dd9f4e304', 'volume_name': 'volume-281d272e-4c39-435d-9866-814dd9f4e304', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de27a695-aa24-4460-9892-ed353f63f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de27a695-aa24-4460-9892-ed353f63f66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc473526-1a73-4d37-a850-8b6d4ca65e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:38 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Volume 281d272e-4c39-435d-9866-814dd9f4e304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281d272e-4c39-435d-9866-814dd9f4e304', 'volume_size': 1} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1666811344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281d272e-4c39-435d-9866-814dd9f4e304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ca2e2b7b2447c1866d76052085a441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:39Z,use_quota=True,user_id='1358fbf1d5094a27a859c1f85ff2efaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba46f3d5-98fb-4cc2-b684-bf0443417270),volume_type_id=ba46f3d5-98fb-4cc2-b684-bf0443417270)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Creating volume 281d272e-4c39-435d-9866-814dd9f4e304 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:38 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 1073741824 Sep 01 02:06:38 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (52638a03-4132-4f95-89df-1478c11449d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb24c0ee-53d0-41e8-8a21-c27816535fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb24c0ee-53d0-41e8-8a21-c27816535fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201145608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598592f1-224f-4085-8f86-3ecfb165c8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:39Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cd502b-fb06-4fb3-a112-e9a58210f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cd502b-fb06-4fb3-a112-e9a58210f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51f4a19-76cd-40b8-aba6-98f0c3d9beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51f4a19-76cd-40b8-aba6-98f0c3d9beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598592f1-224f-4085-8f86-3ecfb165c8d6', 'volume_name': 'volume-598592f1-224f-4085-8f86-3ecfb165c8d6', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8159251-6a60-495d-ad2c-79a575ebe73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8159251-6a60-495d-ad2c-79a575ebe73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615028b6-c4f5-4aa4-8eaf-a6f42317d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume 598592f1-224f-4085-8f86-3ecfb165c8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598592f1-224f-4085-8f86-3ecfb165c8d6', 'volume_size': 1} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:39 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 1073741824" returned: 0 in 0.967s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (b4ed2023-785b-4451-b880-5b06b1ca29cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bc6aae-8b24-4cc5-87d4-c55a340db582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bc6aae-8b24-4cc5-87d4-c55a340db582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1812880405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4d75b1-d8da-48eb-9d31-d7acfd344d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:40Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63929734-4ba7-4b1a-ae55-3584307a75ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63929734-4ba7-4b1a-ae55-3584307a75ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf8c564-83fd-465f-b48f-ea4d93d93895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdf8c564-83fd-465f-b48f-ea4d93d93895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4d75b1-d8da-48eb-9d31-d7acfd344d23', 'volume_name': 'volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91d04c0-6500-4d6c-9422-b44a8ad2d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c91d04c0-6500-4d6c-9422-b44a8ad2d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42641f88-7f53-4a3a-b7f6-24d95315b281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume cd4d75b1-d8da-48eb-9d31-d7acfd344d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23', 'volume_size': 1} Sep 01 02:06:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:40 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 Sep 01 02:06:40 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:40 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304" returned: 0 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-201145608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598592f1-224f-4085-8f86-3ecfb165c8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:39Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Creating volume 598592f1-224f-4085-8f86-3ecfb165c8d6 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:40 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc473526-1a73-4d37-a850-8b6d4ca65e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281d272e-4c39-435d-9866-814dd9f4e304', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 1073741824 Sep 01 02:06:40 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49b3f89-350d-4bb8-b0d1-39af10490b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (25fa055c-3389-4505-b19d-3dfb7e0be4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51666376-c961-411e-99a2-f75cee3d77ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Volume volume-281d272e-4c39-435d-9866-814dd9f4e304 (281d272e-4c39-435d-9866-814dd9f4e304): created successfully Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49b3f89-350d-4bb8-b0d1-39af10490b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Flow 'volume_create_manager' (1a5ce497-3e2e-46d0-9d3f-b8a5e8b1daaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:40 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7370ec0c-91e7-416b-923f-d525bb1bfe71 tempest-VolumeTypesAccessTest-688983598 None] Created volume successfully. Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51666376-c961-411e-99a2-f75cee3d77ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358456511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff05f5cf-7bad-4bd6-bfcb-c0103e04763c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:40Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b864c3-2a4a-4af6-9f2e-855fee553f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b864c3-2a4a-4af6-9f2e-855fee553f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83b6e44-3a28-46b4-b77e-617a1e7da3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83b6e44-3a28-46b4-b77e-617a1e7da3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff05f5cf-7bad-4bd6-bfcb-c0103e04763c', 'volume_name': 'volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bc9d8b-f2be-455d-b80e-5ef246b46505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68bc9d8b-f2be-455d-b80e-5ef246b46505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030da796-135b-4429-89f1-915c092ab698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:40 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume ff05f5cf-7bad-4bd6-bfcb-c0103e04763c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c', 'volume_size': 1} Sep 01 02:06:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Acquiring lock "cinder-281d272e-4c39-435d-9866-814dd9f4e304-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Lock "cinder-281d272e-4c39-435d-9866-814dd9f4e304-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (1d8fd9d5-45e9-439a-997f-485420c861b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7500f3-5512-4289-a27f-60e695a716ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Acquiring lock "cinder-quobyte-281d272e-4c39-435d-9866-814dd9f4e304" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7500f3-5512-4289-a27f-60e695a716ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1805571620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b95b462-aa1b-48fa-9709-869c5494a786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:41Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922aa29e-4bd0-48e1-9ee5-34fc9eb6ba9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (922aa29e-4bd0-48e1-9ee5-34fc9eb6ba9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67689246-5efd-4985-9401-880f4462d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67689246-5efd-4985-9401-880f4462d507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b95b462-aa1b-48fa-9709-869c5494a786', 'volume_name': 'volume-5b95b462-aa1b-48fa-9709-869c5494a786', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767f1818-0940-4ab2-aa95-cc03f3a9ad38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767f1818-0940-4ab2-aa95-cc03f3a9ad38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef653b9b-347f-4fec-9f60-52f4ddb0fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:41 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume 5b95b462-aa1b-48fa-9709-869c5494a786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b95b462-aa1b-48fa-9709-869c5494a786', 'volume_size': 1} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Lock "cinder-quobyte-281d272e-4c39-435d-9866-814dd9f4e304" acquired by "delete_volume" :: waited 0.076s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[27158240-64fc-41c8-ae19-5404a8185ecf]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:41 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 1073741824" returned: 0 in 1.022s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:41 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 Sep 01 02:06:41 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:41 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 Sep 01 02:06:41 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (de7600a3-ed0f-4615-86c3-d820ee8d60a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9376ab93-65ff-41ea-8319-50d6851c8573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9376ab93-65ff-41ea-8319-50d6851c8573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891605253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6b9211-1907-4f63-b9d0-a61fc072b6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:42Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806b5739-6a49-4330-afd3-ee19d965ef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806b5739-6a49-4330-afd3-ee19d965ef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1e4c8c-4bd8-4197-bd79-0983b4091ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1e4c8c-4bd8-4197-bd79-0983b4091ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6b9211-1907-4f63-b9d0-a61fc072b6c5', 'volume_name': 'volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8408017-0e26-4354-8ce1-ed2bf4b60789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8408017-0e26-4354-8ce1-ed2bf4b60789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2626e3c4-7fac-4efa-8044-3c05fa822f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume 0a6b9211-1907-4f63-b9d0-a61fc072b6c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5', 'volume_size': 1} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6" returned: 0 in 0.742s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.337s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1812880405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4d75b1-d8da-48eb-9d31-d7acfd344d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:40Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Creating volume cd4d75b1-d8da-48eb-9d31-d7acfd344d23 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:42 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:42 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304" returned: 0 in 0.924s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:42 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 1073741824 Sep 01 02:06:42 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615028b6-c4f5-4aa4-8eaf-a6f42317d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598592f1-224f-4085-8f86-3ecfb165c8d6', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304 Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9710a6-09af-42ca-944b-5878d98860bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:42 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:42 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume volume-598592f1-224f-4085-8f86-3ecfb165c8d6 (598592f1-224f-4085-8f86-3ecfb165c8d6): created successfully Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9710a6-09af-42ca-944b-5878d98860bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (52638a03-4132-4f95-89df-1478c11449d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-df19801a-5915-40a8-af0e-64407eac59ce tempest-CreateVolumesFromSnapshotTest-117935991 None] Created volume successfully. Sep 01 02:06:42 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-281d272e-4c39-435d-9866-814dd9f4e304" returned: 0 in 0.521s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Lock "cinder-quobyte-281d272e-4c39-435d-9866-814dd9f4e304" released by "delete_volume" :: held 1.545s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:43 devstack cinder-volume[87425]: WARNING cinder.quota [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-268796052 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-268796052, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:43 devstack cinder-volume[87425]: WARNING cinder.quota [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-268796052 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-268796052, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Created reservations ['ad791d1d-15d5-45c5-befe-8e2d4a327c30', '53c2f798-fa01-4078-ba06-87916f54a417', 'ad051c1f-cda6-425b-b888-50391c4b711b', 'f89632b8-fb6f-4a61-a77f-1864e6507913'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:43 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 1073741824" returned: 0 in 0.905s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:43 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:43 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 Sep 01 02:06:43 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.420s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Deleted volume successfully. Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-99686615-c19c-40b3-bc19-c4e385d63ee1 tempest-VolumeTypesAccessTest-688983598 None] Lock "cinder-281d272e-4c39-435d-9866-814dd9f4e304-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:43 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23" returned: 0 in 0.455s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.844s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358456511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff05f5cf-7bad-4bd6-bfcb-c0103e04763c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:40Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Creating volume ff05f5cf-7bad-4bd6-bfcb-c0103e04763c {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:43 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42641f88-7f53-4a3a-b7f6-24d95315b281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:43 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c 1073741824 Sep 01 02:06:43 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f04812-1b3d-4b0a-8f6c-ea7d024cd167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:43 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 (cd4d75b1-d8da-48eb-9d31-d7acfd344d23): created successfully Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3f04812-1b3d-4b0a-8f6c-ea7d024cd167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (b4ed2023-785b-4451-b880-5b06b1ca29cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-43a6d8e6-6fc9-46a1-908b-42fa44964d91 tempest-CreateVolumesFromSnapshotTest-117935991 None] Created volume successfully. Sep 01 02:06:44 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c 1073741824" returned: 0 in 0.893s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:44 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c Sep 01 02:06:44 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:45 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c" returned: 0 in 0.423s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.812s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1805571620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b95b462-aa1b-48fa-9709-869c5494a786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:41Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Creating volume 5b95b462-aa1b-48fa-9709-869c5494a786 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:45 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (030da796-135b-4429-89f1-915c092ab698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:45 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 1073741824 Sep 01 02:06:45 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb84389-d28e-439a-abd5-b50629425051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:45 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c (ff05f5cf-7bad-4bd6-bfcb-c0103e04763c): created successfully Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb84389-d28e-439a-abd5-b50629425051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (25fa055c-3389-4505-b19d-3dfb7e0be4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-dafd394a-9c54-4070-954e-ba232e0aac3f tempest-CreateVolumesFromSnapshotTest-117935991 None] Created volume successfully. Sep 01 02:06:45 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 1073741824" returned: 0 in 0.608s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:45 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 Sep 01 02:06:45 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:46 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786" returned: 0 in 0.343s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.930s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891605253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6b9211-1907-4f63-b9d0-a61fc072b6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e2a06aefdd40a6b3be6b49f7a0ac09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:42Z,use_quota=True,user_id='693f3e3a81644eea81185da9dcf076a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Creating volume 0a6b9211-1907-4f63-b9d0-a61fc072b6c5 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:46 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef653b9b-347f-4fec-9f60-52f4ddb0fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b95b462-aa1b-48fa-9709-869c5494a786', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:46 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 1073741824 Sep 01 02:06:46 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a8e471-3b75-4523-bd31-da3175f2bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:46 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume volume-5b95b462-aa1b-48fa-9709-869c5494a786 (5b95b462-aa1b-48fa-9709-869c5494a786): created successfully Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a8e471-3b75-4523-bd31-da3175f2bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (1d8fd9d5-45e9-439a-997f-485420c861b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a23a563c-97bd-445b-aa0d-ad3f1dad10d0 tempest-CreateVolumesFromSnapshotTest-117935991 None] Created volume successfully. Sep 01 02:06:47 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 1073741824" returned: 0 in 1.169s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:47 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 Sep 01 02:06:47 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:48 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5" returned: 0 in 0.597s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2626e3c4-7fac-4efa-8044-3c05fa822f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8235c108-1eb9-46f1-9c05-5051d2baa94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:48 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Volume volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 (0a6b9211-1907-4f63-b9d0-a61fc072b6c5): created successfully Sep 01 02:06:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8235c108-1eb9-46f1-9c05-5051d2baa94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Flow 'volume_create_manager' (de7600a3-ed0f-4615-86c3-d820ee8d60a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:48 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5d174fb3-4086-4c80-a8b1-f299dd675023 tempest-CreateVolumesFromSnapshotTest-117935991 None] Created volume successfully. Sep 01 02:06:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-0a6b9211-1907-4f63-b9d0-a61fc072b6c5-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-0a6b9211-1907-4f63-b9d0-a61fc072b6c5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-quobyte-0a6b9211-1907-4f63-b9d0-a61fc072b6c5" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-0a6b9211-1907-4f63-b9d0-a61fc072b6c5" acquired by "delete_volume" :: waited 0.041s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:49 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68262c-217b-4b95-8ec7-e7cc6c379105]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:49 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 Sep 01 02:06:49 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:50 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5" returned: 0 in 0.691s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:50 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5 Sep 01 02:06:50 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:50 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0a6b9211-1907-4f63-b9d0-a61fc072b6c5" returned: 0 in 0.532s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-0a6b9211-1907-4f63-b9d0-a61fc072b6c5" released by "delete_volume" :: held 1.324s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Created reservations ['7f738dd3-2eb9-4b49-85de-eab61232775d', '613e2031-7df0-4a4a-9876-5e8cb829a26d', 'b18857df-c05a-4cd6-a5ea-2873bfa3de81', 'a937ed26-37bb-4ce7-9e92-c23fb980c26f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:51 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:51 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:51 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.410s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:51 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Deleted volume successfully. Sep 01 02:06:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c546213-95b6-4b59-aae6-881af0201150 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-0a6b9211-1907-4f63-b9d0-a61fc072b6c5-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-5b95b462-aa1b-48fa-9709-869c5494a786-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-5b95b462-aa1b-48fa-9709-869c5494a786-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-quobyte-5b95b462-aa1b-48fa-9709-869c5494a786" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-5b95b462-aa1b-48fa-9709-869c5494a786" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:52 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[41380641-7bc1-4b2c-ad1f-645583baa0c3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:52 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 Sep 01 02:06:52 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:52 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786" returned: 0 in 0.660s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:52 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786 Sep 01 02:06:52 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:53 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5b95b462-aa1b-48fa-9709-869c5494a786" returned: 0 in 0.525s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-5b95b462-aa1b-48fa-9709-869c5494a786" released by "delete_volume" :: held 1.278s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Created reservations ['cd87e92d-d017-4b74-ac02-f61b6a13b25c', '0c84471c-d764-41b7-9d5f-15728f70616a', '3252f062-9f23-4a6f-90ca-649313320c8b', 'cd88d1e7-68ee-40de-87c8-3bb160e6db4c'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:53 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:53 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:54 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.545s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:54 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Deleted volume successfully. Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-83612724-e58a-4ed8-83ab-1ca873d9225b tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-5b95b462-aa1b-48fa-9709-869c5494a786-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-quobyte-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a5139f-a459-4059-812d-df3f793ea530]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:55 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c Sep 01 02:06:55 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:55 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c" returned: 0 in 0.867s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:55 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c Sep 01 02:06:55 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:55 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Flow 'volume_create_manager' (851e3696-6c7f-4fdf-9743-80a61055f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3932267-1838-44df-8e1b-6e78b7e759cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3932267-1838-44df-8e1b-6e78b7e759cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1725834296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d10563-a359-4e7e-9e29-2f436e59dae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6504c6347b443f9fdabcdaba3752de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:56Z,use_quota=True,user_id='191bf3c9f70c46199d80a99dd44d32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4267bd3-3302-4a76-b85a-eb0003800486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4267bd3-3302-4a76-b85a-eb0003800486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026bc414-61cf-4af3-9ccc-909a17aa9923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026bc414-61cf-4af3-9ccc-909a17aa9923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d10563-a359-4e7e-9e29-2f436e59dae2', 'volume_name': 'volume-33d10563-a359-4e7e-9e29-2f436e59dae2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0ba434-ff2b-4304-b750-2f3bef46f76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0ba434-ff2b-4304-b750-2f3bef46f76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce409f6d-f937-4abc-a3ae-07a5f9514535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Volume 33d10563-a359-4e7e-9e29-2f436e59dae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d10563-a359-4e7e-9e29-2f436e59dae2', 'volume_size': 1} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1725834296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d10563-a359-4e7e-9e29-2f436e59dae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6504c6347b443f9fdabcdaba3752de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:56Z,use_quota=True,user_id='191bf3c9f70c46199d80a99dd44d32e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Creating volume 33d10563-a359-4e7e-9e29-2f436e59dae2 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:56 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:56 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 1073741824 Sep 01 02:06:56 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:56 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c" returned: 0 in 0.457s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c" released by "delete_volume" :: held 1.418s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Created reservations ['1aae2e0b-fdf7-4304-8bc1-f561f80252b7', 'e212e851-fb19-423c-a217-da93444b0f4f', '41354105-48db-4548-a5a1-2cdf323587f8', '0083fbb6-a76a-4c1d-9cb2-08d3d8e1249c'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:56 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:56 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:56 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 1073741824" returned: 0 in 0.630s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:56 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.335s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Deleted volume successfully. Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-07f9ba87-b126-49da-b07e-b53e67086394 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-ff05f5cf-7bad-4bd6-bfcb-c0103e04763c-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:56 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 Sep 01 02:06:56 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-cd4d75b1-d8da-48eb-9d31-d7acfd344d23-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-cd4d75b1-d8da-48eb-9d31-d7acfd344d23-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-quobyte-cd4d75b1-d8da-48eb-9d31-d7acfd344d23" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-cd4d75b1-d8da-48eb-9d31-d7acfd344d23" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c98294-ca39-4cd6-b41d-a52174947a7b]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:57 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2" returned: 0 in 0.379s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce409f6d-f937-4abc-a3ae-07a5f9514535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d10563-a359-4e7e-9e29-2f436e59dae2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def4deff-a2d3-4cf7-8065-efe08a54842b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Volume volume-33d10563-a359-4e7e-9e29-2f436e59dae2 (33d10563-a359-4e7e-9e29-2f436e59dae2): created successfully Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def4deff-a2d3-4cf7-8065-efe08a54842b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Flow 'volume_create_manager' (851e3696-6c7f-4fdf-9743-80a61055f54b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4eea82c5-6304-432b-9f3f-edcf9bda6666 tempest-VolumesMetadataTest-315112245 None] Created volume successfully. Sep 01 02:06:57 devstack sudo[94405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 Sep 01 02:06:57 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:57 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23" returned: 0 in 0.569s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:57 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23 Sep 01 02:06:57 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cd4d75b1-d8da-48eb-9d31-d7acfd344d23" returned: 0 in 0.357s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-cd4d75b1-d8da-48eb-9d31-d7acfd344d23" released by "delete_volume" :: held 0.995s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Created reservations ['7767ce14-1898-4a8a-acab-d5fe779fa6c5', 'bdf07eba-5b43-4d0b-8bc5-f7c75551c935', 'a7629dc8-4e66-4524-845e-3a8c0da88918', 'b4bacf62-d892-4d10-8d47-325d0fe2d7d3'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:58 devstack sudo[94414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:06:58 devstack sudo[94414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[94414]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.445s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:58 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Deleted volume successfully. Sep 01 02:06:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b43fad8-009b-4a4b-aed1-e4732bc277ec tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-cd4d75b1-d8da-48eb-9d31-d7acfd344d23-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Acquiring lock "cinder-33d10563-a359-4e7e-9e29-2f436e59dae2-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Lock "cinder-33d10563-a359-4e7e-9e29-2f436e59dae2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Acquiring lock "cinder-quobyte-33d10563-a359-4e7e-9e29-2f436e59dae2" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Lock "cinder-quobyte-33d10563-a359-4e7e-9e29-2f436e59dae2" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[703ea2d2-48e7-4ec6-9b5a-0c746a7cc5c1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-598592f1-224f-4085-8f86-3ecfb165c8d6-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-598592f1-224f-4085-8f86-3ecfb165c8d6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:59 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 Sep 01 02:06:59 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-quobyte-598592f1-224f-4085-8f86-3ecfb165c8d6" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-598592f1-224f-4085-8f86-3ecfb165c8d6" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba690cc-f082-49a6-8936-6db4769dcdfe]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:59 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 Sep 01 02:06:59 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:59 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2" returned: 0 in 0.597s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:59 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2 Sep 01 02:06:59 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:00 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6" returned: 0 in 0.493s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6 Sep 01 02:07:00 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:00 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-33d10563-a359-4e7e-9e29-2f436e59dae2" returned: 0 in 0.378s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Lock "cinder-quobyte-33d10563-a359-4e7e-9e29-2f436e59dae2" released by "delete_volume" :: held 1.060s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Created reservations ['bdccd895-e3c3-4838-b8aa-1141b7a440b1', '4eec1010-6d93-4f3c-941a-0dfa719ceebf', '748c494d-6497-4629-b840-6cb7ba85d8aa', '1acfa2bf-78db-4aa7-93df-21f49779e941'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:00 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-598592f1-224f-4085-8f86-3ecfb165c8d6" returned: 0 in 0.414s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-598592f1-224f-4085-8f86-3ecfb165c8d6" released by "delete_volume" :: held 0.993s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Created reservations ['f3f5f26c-09f7-415e-a115-08e36997759f', '2a0750de-fc42-4121-ac25-486c7a554a76', '856146b9-cb1a-467a-9a15-01a984fc314a', '7aa0899e-823f-42ab-9d8b-2ab26d71d07d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:00 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:00 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack sudo[94436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:00 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:00 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.364s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:00 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Deleted volume successfully. Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1abe143-6fe2-40a6-9728-9a38f74f01ad tempest-VolumesMetadataTest-315112245 None] Lock "cinder-33d10563-a359-4e7e-9e29-2f436e59dae2-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:01 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.354s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:01 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Deleted volume successfully. Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-868962b2-a639-4c29-893a-975d08dbcfdf tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-598592f1-224f-4085-8f86-3ecfb165c8d6-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-4124a058-befb-4665-a620-73ea7631393f-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-4124a058-befb-4665-a620-73ea7631393f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-quobyte-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-quobyte-4124a058-befb-4665-a620-73ea7631393f" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-4124a058-befb-4665-a620-73ea7631393f" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Deleting offline snapshot 4124a058-befb-4665-a620-73ea7631393f of volume d67151c1-ea49-41e2-ab68-a3c589fa2a2f {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] snapshot_file for this snap is: volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8f01ac-55a6-4efc-8e55-b14eea9f0965]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:02 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f Sep 01 02:07:02 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:02 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f" returned: 0 in 0.724s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:02 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f349930d-b862-4dff-b9a1-231c8e610ae9]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:02 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f Sep 01 02:07:02 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:03 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" returned: 0 in 0.530s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:03 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f Sep 01 02:07:03 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:03 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f" returned: 0 in 0.540s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:03 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f Sep 01 02:07:03 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:04 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f.4124a058-befb-4665-a620-73ea7631393f" returned: 0 in 0.343s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-4124a058-befb-4665-a620-73ea7631393f" released by "_delete_snapshot" :: held 2.328s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" released by "delete_snapshot" :: held 2.382s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:04 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Created reservations ['e2afebae-c359-45f6-9a0b-026bf40ab958', 'e4f55673-243f-48ff-8240-692d369a44f0', '3baadf33-b737-406b-b3da-8a75bad14cba', '1222968f-c310-45ee-89bb-58ee590bd74c'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:04 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Delete snapshot completed successfully. Sep 01 02:07:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-30b0b877-0edb-4927-a6e3-bed2cb718867 tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-4124a058-befb-4665-a620-73ea7631393f-delete_snapshot" released by "delete_snapshot" :: held 2.603s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-d67151c1-ea49-41e2-ab68-a3c589fa2a2f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-d67151c1-ea49-41e2-ab68-a3c589fa2a2f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "cinder-quobyte-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:05 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bae0dc5-a28c-4b93-bb60-93957bf0baf4]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:05 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f Sep 01 02:07:05 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:05 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" returned: 0 in 0.522s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:05 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f Sep 01 02:07:05 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:06 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" returned: 0 in 0.392s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-quobyte-d67151c1-ea49-41e2-ab68-a3c589fa2a2f" released by "delete_volume" :: held 1.013s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Created reservations ['e75fc8a2-ec70-42b1-a8a8-afffd23f610d', '0fb2ea00-76ba-4de3-baee-ff08dccc06c9', 'b56e7d54-f02e-462c-98f6-d1a691e7d65c', '1fbacea8-34ee-40c9-afbb-1bd7fa1c8bd2'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:06 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:06 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:06 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:06 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:06 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.379s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:07:06 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.322s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Deleted volume successfully. Sep 01 02:07:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-12394015-c293-43d7-bff8-5cba67a0909f tempest-CreateVolumesFromSnapshotTest-117935991 None] Lock "cinder-d67151c1-ea49-41e2-ab68-a3c589fa2a2f-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Flow 'volume_create_manager' (53c3787b-a329-4f84-9ef0-72d71962c9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025913d8-e046-47da-9240-897073418f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025913d8-e046-47da-9240-897073418f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1695296628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc8be96-1d38-4b11-aa32-6e6cb79a8192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1785effe4e54bb293b0ba0a5269dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:08Z,use_quota=True,user_id='1681ff7c13da438188dd4b12649ed31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9160a0b-921f-4b5c-890b-148a279c4b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9160a0b-921f-4b5c-890b-148a279c4b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e045cdd8-b440-4af5-8d39-dd2603ae758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e045cdd8-b440-4af5-8d39-dd2603ae758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc8be96-1d38-4b11-aa32-6e6cb79a8192', 'volume_name': 'volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ed875b-894f-4570-aca2-9ce3c552a2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37ed875b-894f-4570-aca2-9ce3c552a2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeba3014-e515-442c-bbbd-f3cd73fbac91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Volume bdc8be96-1d38-4b11-aa32-6e6cb79a8192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192', 'volume_size': 1} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1695296628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc8be96-1d38-4b11-aa32-6e6cb79a8192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1785effe4e54bb293b0ba0a5269dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:08Z,use_quota=True,user_id='1681ff7c13da438188dd4b12649ed31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Creating volume bdc8be96-1d38-4b11-aa32-6e6cb79a8192 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:08 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:08 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 1073741824 Sep 01 02:07:08 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:08 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 1073741824" returned: 0 in 0.611s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:08 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 Sep 01 02:07:08 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:09 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192" returned: 0 in 0.407s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeba3014-e515-442c-bbbd-f3cd73fbac91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708a1a7f-f408-4521-889c-604883e0a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Volume volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 (bdc8be96-1d38-4b11-aa32-6e6cb79a8192): created successfully Sep 01 02:07:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708a1a7f-f408-4521-889c-604883e0a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Flow 'volume_create_manager' (53c3787b-a329-4f84-9ef0-72d71962c9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-06a54b39-5302-47de-8a54-0b84fd15b4ad tempest-VolumesTransfersV355Test-1031053625 None] Created volume successfully. Sep 01 02:07:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c30205e8-5ca9-4358-9e5a-453b275436a1 tempest-VolumesTransfersV355Test-321173086 None] Transfer volume completed successfully. Sep 01 02:07:11 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Flow 'volume_create_manager' (671093d8-b39b-47a8-9700-730a1a5c828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60899587-c8ca-44b7-9419-d2daf4a4b4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60899587-c8ca-44b7-9419-d2daf4a4b4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26565443-ceff-42a3-b7e2-8f94cd78ba0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e43da9a8f94ae28306a32469efb674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:12Z,use_quota=True,user_id='b1a0124f1c4c4da5ad70c6eebd03e451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317ec0cb-0073-42e6-a739-e9a874b69fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (317ec0cb-0073-42e6-a739-e9a874b69fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7783532d-0036-47a9-a829-e09b23c542e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7783532d-0036-47a9-a829-e09b23c542e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26565443-ceff-42a3-b7e2-8f94cd78ba0c', 'volume_name': 'volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edd7741-2368-4f71-acfb-bc14ea95deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5edd7741-2368-4f71-acfb-bc14ea95deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed78870-1f6f-4378-8bd2-dc2656fbf855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:12 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Volume 26565443-ceff-42a3-b7e2-8f94cd78ba0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c', 'volume_size': 1} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26565443-ceff-42a3-b7e2-8f94cd78ba0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e43da9a8f94ae28306a32469efb674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:12Z,use_quota=True,user_id='b1a0124f1c4c4da5ad70c6eebd03e451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Creating volume 26565443-ceff-42a3-b7e2-8f94cd78ba0c {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:12 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:12 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c 1073741824 Sep 01 02:07:12 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:12 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Acquiring lock "cinder-bdc8be96-1d38-4b11-aa32-6e6cb79a8192-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c 1073741824" returned: 0 in 0.749s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Lock "cinder-bdc8be96-1d38-4b11-aa32-6e6cb79a8192-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:13 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c Sep 01 02:07:13 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Acquiring lock "cinder-quobyte-bdc8be96-1d38-4b11-aa32-6e6cb79a8192" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Lock "cinder-quobyte-bdc8be96-1d38-4b11-aa32-6e6cb79a8192" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3d3128-5e8d-4e8c-ba0f-0f47e35249bc]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:13 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 Sep 01 02:07:13 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:13 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c" returned: 0 in 0.303s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed78870-1f6f-4378-8bd2-dc2656fbf855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140d8895-c328-411f-848a-d3e4820ca0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:13 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Volume volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c (26565443-ceff-42a3-b7e2-8f94cd78ba0c): created successfully Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140d8895-c328-411f-848a-d3e4820ca0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Flow 'volume_create_manager' (671093d8-b39b-47a8-9700-730a1a5c828f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f36bfe9a-2d41-42ba-9cd9-f7844393aab2 tempest-CinderUnicodeTest-1695922012 None] Created volume successfully. Sep 01 02:07:13 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192" returned: 0 in 0.493s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:13 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192 Sep 01 02:07:13 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:13 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bdc8be96-1d38-4b11-aa32-6e6cb79a8192" returned: 0 in 0.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Lock "cinder-quobyte-bdc8be96-1d38-4b11-aa32-6e6cb79a8192" released by "delete_volume" :: held 0.831s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:13 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Created reservations ['4983a7ff-4337-4b1f-b2b1-eb8921c5656f', '0d37bd75-18fd-450a-9710-5472c9e95e9f', '009b4387-350c-4230-afd1-e85d0d1e8dbe', '5a86b668-7536-4e24-952d-551d6af0bc2c'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:14 devstack sudo[94541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:14 devstack sudo[94541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:14 devstack sudo[94541]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.433s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Deleted volume successfully. Sep 01 02:07:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ef31dc2-3910-4ca3-9509-dd3dd1a902de tempest-VolumesTransfersV355Test-30910952 None] Lock "cinder-bdc8be96-1d38-4b11-aa32-6e6cb79a8192-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Flow 'volume_create_manager' (1d637b10-506d-480b-8770-4e125eb9ec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b95c2cf-4bd2-4a0f-aa03-15d4e2f58a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b95c2cf-4bd2-4a0f-aa03-15d4e2f58a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-47895985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235c15ed-e760-40c2-9485-cb5d02aaa26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1785effe4e54bb293b0ba0a5269dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:15Z,use_quota=True,user_id='1681ff7c13da438188dd4b12649ed31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f8257a-167a-454a-a354-a7ee8a51b742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f8257a-167a-454a-a354-a7ee8a51b742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397f7cf9-f4f6-4c48-916f-12b5240d5f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397f7cf9-f4f6-4c48-916f-12b5240d5f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235c15ed-e760-40c2-9485-cb5d02aaa26f', 'volume_name': 'volume-235c15ed-e760-40c2-9485-cb5d02aaa26f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31e7ccf-77d4-479f-8348-3dc2bffd1dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31e7ccf-77d4-479f-8348-3dc2bffd1dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bd7a93-0180-4391-8227-f4e058b4ec20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Volume 235c15ed-e760-40c2-9485-cb5d02aaa26f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235c15ed-e760-40c2-9485-cb5d02aaa26f', 'volume_size': 1} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-47895985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=235c15ed-e760-40c2-9485-cb5d02aaa26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1785effe4e54bb293b0ba0a5269dfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:15Z,use_quota=True,user_id='1681ff7c13da438188dd4b12649ed31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Creating volume 235c15ed-e760-40c2-9485-cb5d02aaa26f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:15 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:15 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f 1073741824 Sep 01 02:07:15 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Flow 'volume_create_manager' (777354ef-8bea-4154-a36c-e39d62d71836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4abe9e2c-6f09-45f4-af45-5fe688200d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4abe9e2c-6f09-45f4-af45-5fe688200d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-725658951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e6b423-66bc-4135-b710-7cf383883432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e43da9a8f94ae28306a32469efb674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:15Z,use_quota=True,user_id='b1a0124f1c4c4da5ad70c6eebd03e451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557574c3-1ec9-4d9b-800c-e7fefdb8e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557574c3-1ec9-4d9b-800c-e7fefdb8e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3304f2-dfc7-4b22-8196-298ea8ed5b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca3304f2-dfc7-4b22-8196-298ea8ed5b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e6b423-66bc-4135-b710-7cf383883432', 'volume_name': 'volume-57e6b423-66bc-4135-b710-7cf383883432', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8c99c3-7ae2-4158-a0ef-b02160fa591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8c99c3-7ae2-4158-a0ef-b02160fa591b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5869bdb4-d6c9-4b8c-8c46-f75e8841f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Volume 57e6b423-66bc-4135-b710-7cf383883432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e6b423-66bc-4135-b710-7cf383883432', 'volume_size': 1} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Flow 'volume_create_manager' (c024ae82-381c-4f6a-81f7-0a15cbdfddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e01d4b-e607-4778-ae55-288c80e7351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e01d4b-e607-4778-ae55-288c80e7351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1937692958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9811230b-203b-4c74-bb9a-2891f44e2af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d487ea7e9a4ad2b54cf2913a9a709b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:16Z,use_quota=True,user_id='bc6e04f1c24b4c22b68635463eb07796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da24f676-9893-45cf-b8fe-f5d634c41d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da24f676-9893-45cf-b8fe-f5d634c41d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62a47f0-19fa-43d8-9e1c-4a88f45205bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62a47f0-19fa-43d8-9e1c-4a88f45205bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9811230b-203b-4c74-bb9a-2891f44e2af5', 'volume_name': 'volume-9811230b-203b-4c74-bb9a-2891f44e2af5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83879680-8e47-49b3-aab7-75b4a7ae43c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83879680-8e47-49b3-aab7-75b4a7ae43c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b67e952-7d72-47ce-b9ad-4fa1d269d9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:15 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Volume 9811230b-203b-4c74-bb9a-2891f44e2af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9811230b-203b-4c74-bb9a-2891f44e2af5', 'volume_size': 1} Sep 01 02:07:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:16 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f 1073741824" returned: 0 in 0.711s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:16 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f Sep 01 02:07:16 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:16 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f" returned: 0 in 0.284s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.902s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-725658951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e6b423-66bc-4135-b710-7cf383883432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e43da9a8f94ae28306a32469efb674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:15Z,use_quota=True,user_id='b1a0124f1c4c4da5ad70c6eebd03e451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Creating volume 57e6b423-66bc-4135-b710-7cf383883432 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:16 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bd7a93-0180-4391-8227-f4e058b4ec20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235c15ed-e760-40c2-9485-cb5d02aaa26f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059115bf-0893-439c-b531-04580c26b87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:16 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 1073741824 Sep 01 02:07:16 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:16 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Volume volume-235c15ed-e760-40c2-9485-cb5d02aaa26f (235c15ed-e760-40c2-9485-cb5d02aaa26f): created successfully Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059115bf-0893-439c-b531-04580c26b87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Flow 'volume_create_manager' (1d637b10-506d-480b-8770-4e125eb9ec7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0cd4a8ad-7182-4206-90a3-08705fdd90da tempest-VolumesTransfersV355Test-1031053625 None] Created volume successfully. Sep 01 02:07:16 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 1073741824" returned: 0 in 0.501s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 Sep 01 02:07:17 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:17 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432" returned: 0 in 0.305s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1937692958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9811230b-203b-4c74-bb9a-2891f44e2af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d487ea7e9a4ad2b54cf2913a9a709b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:16Z,use_quota=True,user_id='bc6e04f1c24b4c22b68635463eb07796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Creating volume 9811230b-203b-4c74-bb9a-2891f44e2af5 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:17 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5869bdb4-d6c9-4b8c-8c46-f75e8841f81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e6b423-66bc-4135-b710-7cf383883432', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e124c6f8-3e14-461e-a1ea-c6a5f7f9581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:17 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 1073741824 Sep 01 02:07:17 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:17 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Volume volume-57e6b423-66bc-4135-b710-7cf383883432 (57e6b423-66bc-4135-b710-7cf383883432): created successfully Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e124c6f8-3e14-461e-a1ea-c6a5f7f9581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Flow 'volume_create_manager' (777354ef-8bea-4154-a36c-e39d62d71836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-670daa9b-9f1a-4bbb-a602-7d522c2ea93f tempest-CinderUnicodeTest-1695922012 None] Created volume successfully. Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Acquiring lock "cinder-235c15ed-e760-40c2-9485-cb5d02aaa26f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Lock "cinder-235c15ed-e760-40c2-9485-cb5d02aaa26f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Acquiring lock "cinder-quobyte-235c15ed-e760-40c2-9485-cb5d02aaa26f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Lock "cinder-quobyte-235c15ed-e760-40c2-9485-cb5d02aaa26f" acquired by "delete_volume" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64286d-790b-4850-8528-a169750792d2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f Sep 01 02:07:17 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:18 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 1073741824" returned: 0 in 0.719s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:18 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 Sep 01 02:07:18 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:18 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f" returned: 0 in 0.513s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:18 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f Sep 01 02:07:18 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:18 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5" returned: 0 in 0.405s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b67e952-7d72-47ce-b9ad-4fa1d269d9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9811230b-203b-4c74-bb9a-2891f44e2af5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed0a698-b0b5-42b2-a6f2-b76a2b92c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:18 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Volume volume-9811230b-203b-4c74-bb9a-2891f44e2af5 (9811230b-203b-4c74-bb9a-2891f44e2af5): created successfully Sep 01 02:07:18 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed0a698-b0b5-42b2-a6f2-b76a2b92c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Flow 'volume_create_manager' (c024ae82-381c-4f6a-81f7-0a15cbdfddc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-235c15ed-e760-40c2-9485-cb5d02aaa26f" returned: 0 in 0.426s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Lock "cinder-quobyte-235c15ed-e760-40c2-9485-cb5d02aaa26f" released by "delete_volume" :: held 1.018s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:18 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-44b35660-efe8-432d-b70e-458b07e13d84 tempest-AttachVolumeShelveTestJSON-216669829 None] Created volume successfully. Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Created reservations ['7b15af36-721b-48af-a3f3-12fae10cff24', '22973285-b7f1-47de-941b-1b589bd5ccbd', '02bcc65e-350d-4c66-8579-721bf4bc4999', 'dfc27a00-b8f1-4411-b30b-e3b822e69ba7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Creating offline snapshot 11b95ba4-4960-464b-9344-68040d87de77 of volume 57e6b423-66bc-4135-b710-7cf383883432 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[964d64d7-5664-463f-b0f5-8d82ef63f974]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:19 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:19 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:19 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 Sep 01 02:07:19 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:19 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.415s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Deleted volume successfully. Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8e1c227d-f66d-4229-b656-ff191702388a tempest-VolumesTransfersV355Test-30910952 None] Lock "cinder-235c15ed-e760-40c2-9485-cb5d02aaa26f-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:19 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432" returned: 0 in 0.596s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:19 devstack sudo[94592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 1G Sep 01 02:07:19 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:20 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 1G" returned: 0 in 0.617s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e6b423-66bc-4135-b710-7cf383883432 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:20 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e6b423-66bc-4135-b710-7cf383883432 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 Sep 01 02:07:20 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:20 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57e6b423-66bc-4135-b710-7cf383883432 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77" returned: 0 in 0.420s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:20 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 is being set with open permissions: ugo+rw Sep 01 02:07:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:20 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 Sep 01 02:07:20 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:21 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77" returned: 0 in 0.401s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:21 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.info Sep 01 02:07:21 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:21 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.info" returned: 0 in 0.487s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:21 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.info is being set with open permissions: ugo+rw Sep 01 02:07:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:21 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.info Sep 01 02:07:21 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:22 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.info" returned: 0 in 0.411s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.163s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:22 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:DELETE=15,cinder:SELECT=122,cinder:INSERT=40,cinder:UPDATE=171 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:22 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:INSERT=41,cinder:UPDATE=183,cinder:SELECT=126,cinder:DELETE=15 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c2b4c055-b3ef-4174-af87-3e33f529cd96 tempest-CinderUnicodeTest-1695922012 None] Create snapshot completed successfully Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "cinder-11b95ba4-4960-464b-9344-68040d87de77-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-11b95ba4-4960-464b-9344-68040d87de77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "cinder-quobyte-57e6b423-66bc-4135-b710-7cf383883432" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-quobyte-57e6b423-66bc-4135-b710-7cf383883432" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "cinder-quobyte-11b95ba4-4960-464b-9344-68040d87de77" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-quobyte-11b95ba4-4960-464b-9344-68040d87de77" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Deleting offline snapshot 11b95ba4-4960-464b-9344-68040d87de77 of volume 57e6b423-66bc-4135-b710-7cf383883432 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] snapshot_file for this snap is: volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41709ab-dbd8-4545-98a7-450008a6d39d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:23 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 Sep 01 02:07:23 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:23 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77" returned: 0 in 0.554s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57e6b423-66bc-4135-b710-7cf383883432(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c536a65d-1719-40bb-a0ff-b543386274d1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:24 devstack sudo[94633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 Sep 01 02:07:24 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:24 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432" returned: 0 in 0.537s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:24 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 Sep 01 02:07:24 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:25 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77" returned: 0 in 0.582s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:25 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77 Sep 01 02:07:25 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:25 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432.11b95ba4-4960-464b-9344-68040d87de77" returned: 0 in 0.340s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-quobyte-11b95ba4-4960-464b-9344-68040d87de77" released by "_delete_snapshot" :: held 2.213s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-quobyte-57e6b423-66bc-4135-b710-7cf383883432" released by "delete_snapshot" :: held 2.255s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Created reservations ['8064aca8-67ec-499c-994d-b5e364243520', '74e0f579-202b-4791-b261-190bf388bc91', '527233f1-2be3-4ccd-8426-1d9de39aad56', '0bdf8ac5-c70e-4bd6-8754-0c3ebf612774'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Delete snapshot completed successfully. Sep 01 02:07:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-495c7e2d-306e-4ef0-b268-db077a643c7c tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-11b95ba4-4960-464b-9344-68040d87de77-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "cinder-57e6b423-66bc-4135-b710-7cf383883432-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-57e6b423-66bc-4135-b710-7cf383883432-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "cinder-quobyte-57e6b423-66bc-4135-b710-7cf383883432" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-quobyte-57e6b423-66bc-4135-b710-7cf383883432" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8dde96-5157-4595-8572-4940841246cc]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:27 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 Sep 01 02:07:27 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:27 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432" returned: 0 in 0.596s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:27 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432 Sep 01 02:07:27 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:27 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-57e6b423-66bc-4135-b710-7cf383883432" returned: 0 in 0.349s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-quobyte-57e6b423-66bc-4135-b710-7cf383883432" released by "delete_volume" :: held 1.081s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:27 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Created reservations ['145b3462-25f2-4b39-b3dd-97b609377baa', 'e225d506-957a-4ca2-a05c-c01925f075c6', '0214008a-2ae4-4de2-af31-0196d8c72a13', '9c1bc0d7-9ea6-4f2b-97d8-fdc1d5972e75'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:28 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:28 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.483s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:28 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Deleted volume successfully. Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e634ea2a-332c-4e5a-8430-1638ee7b2257 tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-57e6b423-66bc-4135-b710-7cf383883432-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "cinder-26565443-ceff-42a3-b7e2-8f94cd78ba0c-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-26565443-ceff-42a3-b7e2-8f94cd78ba0c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "cinder-quobyte-26565443-ceff-42a3-b7e2-8f94cd78ba0c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-quobyte-26565443-ceff-42a3-b7e2-8f94cd78ba0c" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:29 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d381b-8d88-4bfd-ad3b-b4dc10396b63]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:29 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c Sep 01 02:07:29 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:29 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c" returned: 0 in 0.509s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:29 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c Sep 01 02:07:29 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Flow 'volume_create_manager' (84d10c28-5477-4760-941f-384c82e91951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b3d852-52d2-4800-8c2f-c9068b3160a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b3d852-52d2-4800-8c2f-c9068b3160a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-443955088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a726fdd7-6f57-47fd-8c87-3f0b3487e274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1455f3e31bd439c8e083bb99c86c460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:30Z,use_quota=True,user_id='2d7fdc5a55d94d04a139a7698d0496b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776bc078-bc49-40ed-9bf2-5192a501cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (776bc078-bc49-40ed-9bf2-5192a501cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:30 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e001ddb-493d-4169-b594-21a03896d198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e001ddb-493d-4169-b594-21a03896d198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a726fdd7-6f57-47fd-8c87-3f0b3487e274', 'volume_name': 'volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274', 'volume_size': 2}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7060f760-e832-4a99-acfd-6fc70f5015a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7060f760-e832-4a99-acfd-6fc70f5015a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df333ec-7fb6-44f6-845f-5f64dac8fd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:30 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Volume a726fdd7-6f57-47fd-8c87-3f0b3487e274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274', 'volume_size': 2} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-443955088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a726fdd7-6f57-47fd-8c87-3f0b3487e274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1455f3e31bd439c8e083bb99c86c460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:30Z,use_quota=True,user_id='2d7fdc5a55d94d04a139a7698d0496b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Creating volume a726fdd7-6f57-47fd-8c87-3f0b3487e274 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:30 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 2147483648 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-26565443-ceff-42a3-b7e2-8f94cd78ba0c" returned: 0 in 0.783s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:30 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 2147483648 Sep 01 02:07:30 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-quobyte-26565443-ceff-42a3-b7e2-8f94cd78ba0c" released by "delete_volume" :: held 1.371s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Created reservations ['510974a7-fcc8-4b56-b49a-a8b766dad492', '3514d98b-3922-42ea-a783-0297b129f7d4', '8ef088eb-4052-41c8-bac3-e7de219dbfb0', '05a1e528-c708-45bb-848b-edfb24215dc2'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:30 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:30 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:31 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.353s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Deleted volume successfully. Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd9fb715-2d33-443d-a275-faa7c2e45136 tempest-CinderUnicodeTest-1695922012 None] Lock "cinder-26565443-ceff-42a3-b7e2-8f94cd78ba0c-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:31 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 2147483648" returned: 0 in 0.828s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:31 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 Sep 01 02:07:31 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:31 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274" returned: 0 in 0.328s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df333ec-7fb6-44f6-845f-5f64dac8fd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274', 'volume_size': 2}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d19e227-2dee-41c6-90be-aba69aa36731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:31 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Volume volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 (a726fdd7-6f57-47fd-8c87-3f0b3487e274): created successfully Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d19e227-2dee-41c6-90be-aba69aa36731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Flow 'volume_create_manager' (84d10c28-5477-4760-941f-384c82e91951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d9961b64-f2f9-4047-b835-e66121719b80 tempest-VolumesCloneNegativeTest-1174563947 None] Created volume successfully. Sep 01 02:07:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Acquiring lock "cinder-a726fdd7-6f57-47fd-8c87-3f0b3487e274-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "cinder-a726fdd7-6f57-47fd-8c87-3f0b3487e274-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Acquiring lock "cinder-quobyte-a726fdd7-6f57-47fd-8c87-3f0b3487e274" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "cinder-quobyte-a726fdd7-6f57-47fd-8c87-3f0b3487e274" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[561ca295-d744-4f91-a076-c20dab5b880d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:32 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 Sep 01 02:07:32 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:33 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274" returned: 0 in 0.574s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:33 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274 Sep 01 02:07:33 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-c2f2c079-7eec-4e16-a9dd-fcc282bf3ac0 req-08e704e7-9d7b-48ae-9889-decdb4b3fa47 tempest-AttachVolumeShelveTestJSON-216669829 None] No connector for attachment f1bcbb5c-c714-4071-aac9-5d9c719da54c; skipping storage backend terminate_connection call. {{(pid=87425) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-c2f2c079-7eec-4e16-a9dd-fcc282bf3ac0 req-08e704e7-9d7b-48ae-9889-decdb4b3fa47 tempest-AttachVolumeShelveTestJSON-216669829 None] Deleting attachment f1bcbb5c-c714-4071-aac9-5d9c719da54c. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:07:33 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a726fdd7-6f57-47fd-8c87-3f0b3487e274" returned: 0 in 0.348s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "cinder-quobyte-a726fdd7-6f57-47fd-8c87-3f0b3487e274" released by "delete_volume" :: held 1.011s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Created reservations ['fb113056-3ba7-4e24-93c2-c7669d311774', '4596a711-ae6d-4cba-b5e9-023c3d9520dd', 'cb0830d6-b2ba-4360-8223-72f998d58931', '1dd5a83d-3cbf-4ca2-8759-b2b3ef53dfca'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:33 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:07:33 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:34 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:34 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Deleted volume successfully. Sep 01 02:07:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a562ebb9-330e-44ca-8d14-330e3ec73460 tempest-VolumesCloneNegativeTest-1174563947 None] Lock "cinder-a726fdd7-6f57-47fd-8c87-3f0b3487e274-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:43 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:DELETE=3,cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=35 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:44 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=27,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:54 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (dafa2e00-9c6d-48dc-9a1a-32477727a9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e01df3-b9a6-4e3d-aafd-bfc079747819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92e01df3-b9a6-4e3d-aafd-bfc079747819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1403562354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317da739-08b0-41f4-9e84-01755f0e09d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:56Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67574d2-3eab-44e9-ac93-d36485e6ebdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67574d2-3eab-44e9-ac93-d36485e6ebdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8696af-4b48-4034-aade-25a9748587d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8696af-4b48-4034-aade-25a9748587d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317da739-08b0-41f4-9e84-01755f0e09d4', 'volume_name': 'volume-317da739-08b0-41f4-9e84-01755f0e09d4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a786359-6c81-410e-90c0-aa099e5448b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a786359-6c81-410e-90c0-aa099e5448b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dd4663-bf37-4d54-88c4-2a0be5a75736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Volume 317da739-08b0-41f4-9e84-01755f0e09d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317da739-08b0-41f4-9e84-01755f0e09d4', 'volume_size': 1} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1403562354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317da739-08b0-41f4-9e84-01755f0e09d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:56Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Creating volume 317da739-08b0-41f4-9e84-01755f0e09d4 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:56 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:07:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:56 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 1073741824 Sep 01 02:07:56 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:57 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 1073741824" returned: 0 in 0.733s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:57 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 Sep 01 02:07:57 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:57 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4" returned: 0 in 0.316s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34dd4663-bf37-4d54-88c4-2a0be5a75736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317da739-08b0-41f4-9e84-01755f0e09d4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5addba00-6869-4d1d-a1da-caeb2594e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Volume volume-317da739-08b0-41f4-9e84-01755f0e09d4 (317da739-08b0-41f4-9e84-01755f0e09d4): created successfully Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5addba00-6869-4d1d-a1da-caeb2594e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (dafa2e00-9c6d-48dc-9a1a-32477727a9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d26d0b28-a1d2-4aec-82c1-6f8110abb37d tempest-VolumesActionsTest-1202726206 None] Created volume successfully. Sep 01 02:07:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f04fdfb3-407b-433b-b5e8-328159787e6c tempest-VolumesActionsTest-1202726206 None] Acquiring lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4" by "attach_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f04fdfb3-407b-433b-b5e8-328159787e6c tempest-VolumesActionsTest-1202726206 None] Lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4" acquired by "attach_volume" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:58 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f04fdfb3-407b-433b-b5e8-328159787e6c tempest-VolumesActionsTest-1202726206 None] Attaching volume 317da739-08b0-41f4-9e84-01755f0e09d4 to instance bb6365e7-008a-43a9-81d6-10919e237a54 at mountpoint /dev/vdb on host None. Sep 01 02:07:58 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f04fdfb3-407b-433b-b5e8-328159787e6c tempest-VolumesActionsTest-1202726206 None] Attach volume completed successfully. Sep 01 02:07:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f04fdfb3-407b-433b-b5e8-328159787e6c tempest-VolumesActionsTest-1202726206 None] Lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4" released by "attach_volume" :: held 0.167s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e1e973dc-d745-438c-8a1d-d63bdf22ef43 tempest-VolumesActionsTest-2052958329 None] Terminate volume connection completed successfully. Sep 01 02:08:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1e973dc-d745-438c-8a1d-d63bdf22ef43 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-detach_volume" by "detach_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1e973dc-d745-438c-8a1d-d63bdf22ef43 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e1e973dc-d745-438c-8a1d-d63bdf22ef43 tempest-VolumesActionsTest-2052958329 None] Detaching volume 317da739-08b0-41f4-9e84-01755f0e09d4 from instance bb6365e7-008a-43a9-81d6-10919e237a54. Sep 01 02:08:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e1e973dc-d745-438c-8a1d-d63bdf22ef43 tempest-VolumesActionsTest-2052958329 None] Detach volume completed successfully. Sep 01 02:08:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1e973dc-d745-438c-8a1d-d63bdf22ef43 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-detach_volume" released by "detach_volume" :: held 0.154s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-29722a3a-d015-4157-888a-76afed864648 tempest-VolumesActionsTest-1202726206 None] Acquiring lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-detach_volume" by "detach_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-29722a3a-d015-4157-888a-76afed864648 tempest-VolumesActionsTest-1202726206 None] Lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-29722a3a-d015-4157-888a-76afed864648 tempest-VolumesActionsTest-1202726206 None] Volume detach called, but volume not attached. Sep 01 02:08:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-29722a3a-d015-4157-888a-76afed864648 tempest-VolumesActionsTest-1202726206 None] Lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Acquiring lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Acquiring lock "cinder-quobyte-317da739-08b0-41f4-9e84-01755f0e09d4" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Lock "cinder-quobyte-317da739-08b0-41f4-9e84-01755f0e09d4" acquired by "delete_volume" :: waited 0.047s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[304ba744-b9b3-474b-b56d-4d9a6575df2e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:01 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 Sep 01 02:08:01 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:02 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4" returned: 0 in 1.122s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:02 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4 Sep 01 02:08:02 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:03 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-317da739-08b0-41f4-9e84-01755f0e09d4" returned: 0 in 0.716s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Lock "cinder-quobyte-317da739-08b0-41f4-9e84-01755f0e09d4" released by "delete_volume" :: held 1.964s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:03 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Created reservations ['b0a3f823-58b8-4fb6-bef6-b9f15d947cb7', '34d018f7-e3ad-40f5-babd-78496dcd57fb', 'efe99fc3-25d1-45b7-ab0c-7cb358d1aad0', '9dd30e25-4854-40dc-ae7a-bf742f4d4181'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:04 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:08:04 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:04 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.587s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:04 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Deleted volume successfully. Sep 01 02:08:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6ae08290-7b0a-4f43-a8b0-00d7e24c4707 tempest-VolumesActionsTest-1202726206 None] Lock "cinder-317da739-08b0-41f4-9e84-01755f0e09d4-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:06 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:08:06 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:06 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.464s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:08:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (e816b68b-12a9-4c29-88a4-002b48c6ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b46f080-58ce-4a82-9218-079b22959242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b46f080-58ce-4a82-9218-079b22959242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645447274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57f7a9c-4dee-4853-a165-0bb233245d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:10Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222892d4-f5a7-48e5-8a3e-e8607ac00b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222892d4-f5a7-48e5-8a3e-e8607ac00b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1078a002-c411-4240-8e69-2ffd7c1428ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1078a002-c411-4240-8e69-2ffd7c1428ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57f7a9c-4dee-4853-a165-0bb233245d65', 'volume_name': 'volume-b57f7a9c-4dee-4853-a165-0bb233245d65', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3852eb3d-29a8-4e23-8464-428433ca6f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3852eb3d-29a8-4e23-8464-428433ca6f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161af336-64ee-451e-8dfe-219456288329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Volume b57f7a9c-4dee-4853-a165-0bb233245d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57f7a9c-4dee-4853-a165-0bb233245d65', 'volume_size': 1} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645447274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57f7a9c-4dee-4853-a165-0bb233245d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:10Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Creating volume b57f7a9c-4dee-4853-a165-0bb233245d65 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:09 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:08:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:09 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 1073741824 Sep 01 02:08:09 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:10 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 1073741824" returned: 0 in 0.531s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:10 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 Sep 01 02:08:10 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:10 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65" returned: 0 in 0.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161af336-64ee-451e-8dfe-219456288329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57f7a9c-4dee-4853-a165-0bb233245d65', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86881df-226b-4d23-b576-dbb7fc0ac117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Volume volume-b57f7a9c-4dee-4853-a165-0bb233245d65 (b57f7a9c-4dee-4853-a165-0bb233245d65): created successfully Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86881df-226b-4d23-b576-dbb7fc0ac117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (e816b68b-12a9-4c29-88a4-002b48c6ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-13b6bcf9-c81d-4f6d-aa52-eac0d0b8798b tempest-VolumesActionsTest-1202726206 None] Created volume successfully. Sep 01 02:08:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-b57f7a9c-4dee-4853-a165-0bb233245d65-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-b57f7a9c-4dee-4853-a165-0bb233245d65-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-quobyte-b57f7a9c-4dee-4853-a165-0bb233245d65" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-quobyte-b57f7a9c-4dee-4853-a165-0bb233245d65" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f0a512-0570-4d52-b431-a15b5dcb2855]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:12 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 Sep 01 02:08:12 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:12 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65" returned: 0 in 0.406s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:12 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65 Sep 01 02:08:12 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:12 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b57f7a9c-4dee-4853-a165-0bb233245d65" returned: 0 in 0.274s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-quobyte-b57f7a9c-4dee-4853-a165-0bb233245d65" released by "delete_volume" :: held 0.728s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Created reservations ['6f50b497-25f2-42d1-86a3-738b0381c2d5', '3340c508-1798-4ef1-adc8-501b1cbfe5c3', '1a085503-191b-483d-8c3d-80121a629d00', 'd30f4694-6537-41a0-8f16-aaec045d589a'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:12 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:08:12 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:13 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.377s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Deleted volume successfully. Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e9f67c11-4d8a-491d-a6a9-2d076dd844c1 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-b57f7a9c-4dee-4853-a165-0bb233245d65-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (0a312709-c438-45f4-a753-1175633e55ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52469641-c6a7-47a8-b940-c9514c6e6db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52469641-c6a7-47a8-b940-c9514c6e6db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1094857933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763470fc-e148-4c59-8bba-2d100fde5562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:14Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e0ff48-a2d4-4365-8402-1d6fdf64538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e0ff48-a2d4-4365-8402-1d6fdf64538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011d067b-f24e-498c-9b09-a55fe4eec0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011d067b-f24e-498c-9b09-a55fe4eec0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '763470fc-e148-4c59-8bba-2d100fde5562', 'volume_name': 'volume-763470fc-e148-4c59-8bba-2d100fde5562', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15dfff2-2f8e-4ab9-ac45-84a8ce82c01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15dfff2-2f8e-4ab9-ac45-84a8ce82c01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c13753e-2391-4fd8-84a9-f7efd5a26d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:14 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Volume 763470fc-e148-4c59-8bba-2d100fde5562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-763470fc-e148-4c59-8bba-2d100fde5562', 'volume_size': 1} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1094857933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763470fc-e148-4c59-8bba-2d100fde5562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:14Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Creating volume 763470fc-e148-4c59-8bba-2d100fde5562 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:14 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 1073741824 Sep 01 02:08:14 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 1073741824" returned: 0 in 0.579s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:14 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 Sep 01 02:08:14 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562" returned: 0 in 0.296s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c13753e-2391-4fd8-84a9-f7efd5a26d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763470fc-e148-4c59-8bba-2d100fde5562', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d69824d-0547-42b0-873b-f6f4e7ad38eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:15 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Volume volume-763470fc-e148-4c59-8bba-2d100fde5562 (763470fc-e148-4c59-8bba-2d100fde5562): created successfully Sep 01 02:08:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d69824d-0547-42b0-873b-f6f4e7ad38eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (0a312709-c438-45f4-a753-1175633e55ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-997760ed-f761-4aae-b1ca-c0f50da2ce6f tempest-VolumesActionsTest-1202726206 None] Created volume successfully. Sep 01 02:08:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-763470fc-e148-4c59-8bba-2d100fde5562-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-763470fc-e148-4c59-8bba-2d100fde5562-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-quobyte-763470fc-e148-4c59-8bba-2d100fde5562" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-quobyte-763470fc-e148-4c59-8bba-2d100fde5562" acquired by "delete_volume" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:16 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a13987-d3a9-404f-a86b-71aa731ac542]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:16 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 Sep 01 02:08:16 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:17 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562" returned: 0 in 0.444s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:17 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562 Sep 01 02:08:17 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:17 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-763470fc-e148-4c59-8bba-2d100fde5562" returned: 0 in 0.281s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-quobyte-763470fc-e148-4c59-8bba-2d100fde5562" released by "delete_volume" :: held 0.782s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Created reservations ['e2edfa79-da39-4099-990f-35844cd644de', 'cc9a9827-38fb-4a16-b5b7-f080f9cf2f20', '2e2924eb-ca3a-42b8-85e6-31e957b6d06d', 'f10791e4-9654-4c5f-9526-8e4b56303b3d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:17 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:08:17 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:17 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Deleted volume successfully. Sep 01 02:08:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb1711bb-ddc5-4049-afec-50178625f203 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-763470fc-e148-4c59-8bba-2d100fde5562-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (34b9edc3-a50b-453c-ae5d-492fb74f774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac85950f-cfd1-412e-8fa3-8268c7912a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac85950f-cfd1-412e-8fa3-8268c7912a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419042098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a173c9-1ba5-4a98-bf99-557bdda15299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:18Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3827e0-2f6d-4e88-a677-081901c5c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3827e0-2f6d-4e88-a677-081901c5c093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14457ace-27fa-4079-8872-1062d6943f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14457ace-27fa-4079-8872-1062d6943f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a173c9-1ba5-4a98-bf99-557bdda15299', 'volume_name': 'volume-84a173c9-1ba5-4a98-bf99-557bdda15299', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a14e92c-44b6-49f9-a6b2-5ded4d501067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a14e92c-44b6-49f9-a6b2-5ded4d501067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9b595f-7754-45ab-9ca5-dd05be48d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:18 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Volume 84a173c9-1ba5-4a98-bf99-557bdda15299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a173c9-1ba5-4a98-bf99-557bdda15299', 'volume_size': 1} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419042098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a173c9-1ba5-4a98-bf99-557bdda15299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:18Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Creating volume 84a173c9-1ba5-4a98-bf99-557bdda15299 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:18 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:08:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:18 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 1073741824 Sep 01 02:08:18 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:19 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 1073741824" returned: 0 in 0.859s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:19 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 Sep 01 02:08:19 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:19 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299" returned: 0 in 0.400s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9b595f-7754-45ab-9ca5-dd05be48d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a173c9-1ba5-4a98-bf99-557bdda15299', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898da985-49be-4b19-8cee-e87cd063e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Volume volume-84a173c9-1ba5-4a98-bf99-557bdda15299 (84a173c9-1ba5-4a98-bf99-557bdda15299): created successfully Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898da985-49be-4b19-8cee-e87cd063e231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (34b9edc3-a50b-453c-ae5d-492fb74f774d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-bb9e3318-94ce-48a8-ad09-8472cb31444e tempest-VolumesActionsTest-1202726206 None] Created volume successfully. Sep 01 02:08:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-84a173c9-1ba5-4a98-bf99-557bdda15299-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-84a173c9-1ba5-4a98-bf99-557bdda15299-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-quobyte-84a173c9-1ba5-4a98-bf99-557bdda15299" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-quobyte-84a173c9-1ba5-4a98-bf99-557bdda15299" acquired by "delete_volume" :: waited 0.044s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:20 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e0614-0443-4a98-a977-e9303cbc18c1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 Sep 01 02:08:21 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299" returned: 0 in 0.482s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:21 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299 Sep 01 02:08:21 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:21 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-84a173c9-1ba5-4a98-bf99-557bdda15299" returned: 0 in 0.406s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-quobyte-84a173c9-1ba5-4a98-bf99-557bdda15299" released by "delete_volume" :: held 0.967s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:21 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Created reservations ['e9bde591-f965-45f9-83d9-526934c82923', '90bcc382-06be-4a6e-bae6-39d16fb7248c', '048b7aef-08dc-43b6-84e8-de37f47bd44f', '5e0739c3-147b-4fc1-9ca9-aa56f60e9222'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:22 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:08:22 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:22 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.337s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Deleted volume successfully. Sep 01 02:08:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-98189a19-39dc-4c06-859a-477102a0d957 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-84a173c9-1ba5-4a98-bf99-557bdda15299-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (34cfef5d-2ad0-49d1-bc79-e98cde52ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8a39fd-49e1-4193-8fa5-d58302f4232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8a39fd-49e1-4193-8fa5-d58302f4232e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2105493785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534918c5-7015-421c-8da6-959aed2679ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:24Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644404ea-4fc4-42b1-918e-dd1166952753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644404ea-4fc4-42b1-918e-dd1166952753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05f9faf-129c-449d-adbf-40b3343e2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05f9faf-129c-449d-adbf-40b3343e2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '534918c5-7015-421c-8da6-959aed2679ba', 'volume_name': 'volume-534918c5-7015-421c-8da6-959aed2679ba', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fee736-402c-4ba6-81f6-af2232f6f86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fee736-402c-4ba6-81f6-af2232f6f86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5fabab-c839-4168-b21d-40eb6b509680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Volume 534918c5-7015-421c-8da6-959aed2679ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-534918c5-7015-421c-8da6-959aed2679ba', 'volume_size': 1} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2105493785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=534918c5-7015-421c-8da6-959aed2679ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:24Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Creating volume 534918c5-7015-421c-8da6-959aed2679ba {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:23 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:08:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:23 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba 1073741824 Sep 01 02:08:23 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Acquiring lock "cinder-9811230b-203b-4c74-bb9a-2891f44e2af5-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "cinder-9811230b-203b-4c74-bb9a-2891f44e2af5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Acquiring lock "cinder-quobyte-9811230b-203b-4c74-bb9a-2891f44e2af5" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "cinder-quobyte-9811230b-203b-4c74-bb9a-2891f44e2af5" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:24 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba 1073741824" returned: 0 in 0.612s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa36c8-3d1c-48d7-ac5f-cd120781625d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:24 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba Sep 01 02:08:24 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 Sep 01 02:08:24 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:24 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba" returned: 0 in 0.285s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf5fabab-c839-4168-b21d-40eb6b509680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-534918c5-7015-421c-8da6-959aed2679ba', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0cbe80-a808-4404-a001-bff327c9d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Volume volume-534918c5-7015-421c-8da6-959aed2679ba (534918c5-7015-421c-8da6-959aed2679ba): created successfully Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0cbe80-a808-4404-a001-bff327c9d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (34cfef5d-2ad0-49d1-bc79-e98cde52ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5ba2e0a0-1df5-45db-95dc-a3a612174d1d tempest-VolumesActionsTest-1202726206 None] Created volume successfully. Sep 01 02:08:24 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5" returned: 0 in 0.461s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:25 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5 Sep 01 02:08:25 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:25 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9811230b-203b-4c74-bb9a-2891f44e2af5" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "cinder-quobyte-9811230b-203b-4c74-bb9a-2891f44e2af5" released by "delete_volume" :: held 0.809s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Created reservations ['5e2c109e-b4c2-4f26-ae3c-996d944de907', '86175ba8-4653-4f12-86b0-466723fdb8c5', 'ee0af9d3-cb23-43e0-85fe-83a500920084', '9ae4d227-450e-4c0f-ae50-0e55e20a191e'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:25 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:08:25 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:25 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.310s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Deleted volume successfully. Sep 01 02:08:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9c15e811-aab5-45ff-9576-38f200b2fa86 tempest-AttachVolumeShelveTestJSON-216669829 None] Lock "cinder-9811230b-203b-4c74-bb9a-2891f44e2af5-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-534918c5-7015-421c-8da6-959aed2679ba-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-534918c5-7015-421c-8da6-959aed2679ba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "cinder-quobyte-534918c5-7015-421c-8da6-959aed2679ba" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-quobyte-534918c5-7015-421c-8da6-959aed2679ba" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b58a27-57ef-4885-ad71-62019a5dd0dc]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:26 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba Sep 01 02:08:26 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:26 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba" returned: 0 in 0.553s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:26 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba Sep 01 02:08:26 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:27 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-534918c5-7015-421c-8da6-959aed2679ba" returned: 0 in 0.442s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-quobyte-534918c5-7015-421c-8da6-959aed2679ba" released by "delete_volume" :: held 1.058s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Created reservations ['ff105a60-2a77-4986-8fbf-5f5f51f27377', '696b2c21-71eb-4f01-99a7-cfd6befa1766', 'd1ce4971-fbd2-46b6-bd21-aa4c370623d6', '369cb053-0a5a-4076-8d54-a0905b9da128'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:27 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:08:27 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:27 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.370s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Deleted volume successfully. Sep 01 02:08:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cc08b8ff-116a-4b79-9649-7698bf7ae0a3 tempest-VolumesActionsTest-2052958329 None] Lock "cinder-534918c5-7015-421c-8da6-959aed2679ba-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (94d22df7-9c74-48ae-ac59-98c86edf8480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d39394-48b2-43ec-ae48-a41395980824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d39394-48b2-43ec-ae48-a41395980824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563998312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01833a7-a4bd-4658-8619-8c20c4529aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:29Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83c16c3-b35f-4373-9cf8-5037327a069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83c16c3-b35f-4373-9cf8-5037327a069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f766dd-1f23-43b1-9c33-77e97ccdb492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f766dd-1f23-43b1-9c33-77e97ccdb492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01833a7-a4bd-4658-8619-8c20c4529aa6', 'volume_name': 'volume-f01833a7-a4bd-4658-8619-8c20c4529aa6', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67c8345-2ec1-4527-bcfa-1883bad67acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67c8345-2ec1-4527-bcfa-1883bad67acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ee381c-7fe4-40fe-ade5-301110021042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:29 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Volume f01833a7-a4bd-4658-8619-8c20c4529aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01833a7-a4bd-4658-8619-8c20c4529aa6', 'volume_size': 1} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1563998312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01833a7-a4bd-4658-8619-8c20c4529aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ea439c44ddc47048a1969debd63e295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:29Z,use_quota=True,user_id='1b98cd63bc184a0284934120ce95b688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Creating volume f01833a7-a4bd-4658-8619-8c20c4529aa6 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:29 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:29 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 1073741824 Sep 01 02:08:29 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:29 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 1073741824" returned: 0 in 0.612s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:30 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 Sep 01 02:08:30 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:30 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6" returned: 0 in 0.295s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ee381c-7fe4-40fe-ade5-301110021042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01833a7-a4bd-4658-8619-8c20c4529aa6', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6cd2e7-9212-469b-9710-8b0f6053357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:30 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Volume volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 (f01833a7-a4bd-4658-8619-8c20c4529aa6): created successfully Sep 01 02:08:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6cd2e7-9212-469b-9710-8b0f6053357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Flow 'volume_create_manager' (94d22df7-9c74-48ae-ac59-98c86edf8480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-57828eb9-c099-4502-950b-e9817dbeefbb tempest-VolumesActionsTest-1202726206 None] Created volume successfully. Sep 01 02:08:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Acquiring lock "cinder-f01833a7-a4bd-4658-8619-8c20c4529aa6-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Lock "cinder-f01833a7-a4bd-4658-8619-8c20c4529aa6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Acquiring lock "cinder-quobyte-f01833a7-a4bd-4658-8619-8c20c4529aa6" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Lock "cinder-quobyte-f01833a7-a4bd-4658-8619-8c20c4529aa6" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4dd501-2c25-4887-9d68-64abbb8884d5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:33 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 Sep 01 02:08:33 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:33 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6" returned: 0 in 0.898s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:33 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6 Sep 01 02:08:33 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:34 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f01833a7-a4bd-4658-8619-8c20c4529aa6" returned: 0 in 0.413s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Lock "cinder-quobyte-f01833a7-a4bd-4658-8619-8c20c4529aa6" released by "delete_volume" :: held 1.377s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Created reservations ['d4a46f3a-54d1-4754-858b-ae431f14c335', '671c9cc2-f52b-4a93-b54f-290965f627d3', '8496bf60-7a27-4226-a126-322680103296', 'aa6b3719-a288-4977-b2a1-6e69a8bb2616'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:34 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:08:34 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:34 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.401s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Deleted volume successfully. Sep 01 02:08:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ee4947a2-0eb0-4387-8ea7-7ae7ea03451e tempest-VolumesActionsTest-1202726206 None] Lock "cinder-f01833a7-a4bd-4658-8619-8c20c4529aa6-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Flow 'volume_create_manager' (b6e7a6bb-661a-452c-9f8f-3182b11ce5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf2555c-b887-4393-a1b0-9edbf6c4a5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf2555c-b887-4393-a1b0-9edbf6c4a5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-979660966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ff3a04-600d-4a6f-9196-9b42c2d2d404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ffa3a007354f4d841cf02f4b395e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:37Z,use_quota=True,user_id='674b67eff0c74b828be67706429357a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2dcb11-32c9-4695-b7ca-ba4a11acfbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2dcb11-32c9-4695-b7ca-ba4a11acfbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04af96c6-e318-4d3a-a54f-c001a424c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04af96c6-e318-4d3a-a54f-c001a424c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ff3a04-600d-4a6f-9196-9b42c2d2d404', 'volume_name': 'volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3e09f2-8093-4f18-8c25-7a7f4727d2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d3e09f2-8093-4f18-8c25-7a7f4727d2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734ff179-1a07-4ae5-a52c-39ba4023922d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:37 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Volume 31ff3a04-600d-4a6f-9196-9b42c2d2d404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404', 'volume_size': 1} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-979660966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ff3a04-600d-4a6f-9196-9b42c2d2d404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11ffa3a007354f4d841cf02f4b395e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:37Z,use_quota=True,user_id='674b67eff0c74b828be67706429357a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Creating volume 31ff3a04-600d-4a6f-9196-9b42c2d2d404 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:37 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:08:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:37 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 1073741824 Sep 01 02:08:37 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:38 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 1073741824" returned: 0 in 0.827s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:38 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 Sep 01 02:08:38 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:38 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404" returned: 0 in 0.426s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] <== create_volume: return (1325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734ff179-1a07-4ae5-a52c-39ba4023922d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28004b3d-d1d5-440b-8549-c7ee7cc4fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:38 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Volume volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 (31ff3a04-600d-4a6f-9196-9b42c2d2d404): created successfully Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28004b3d-d1d5-440b-8549-c7ee7cc4fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Flow 'volume_create_manager' (b6e7a6bb-661a-452c-9f8f-3182b11ce5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:38 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-692a1ef9-4a26-492c-8e66-b7ce9ed00e84 tempest-TestMinimumBasicScenario-113193968 None] Created volume successfully. Sep 01 02:08:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-5884e44f-d996-47c8-a02d-e739d3efdccc req-69021384-9f5a-4914-8f12-1fe743b49861 tempest-TestMinimumBasicScenario-113193968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-5884e44f-d996-47c8-a02d-e739d3efdccc req-69021384-9f5a-4914-8f12-1fe743b49861 tempest-TestMinimumBasicScenario-113193968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-5884e44f-d996-47c8-a02d-e739d3efdccc req-69021384-9f5a-4914-8f12-1fe743b49861 tempest-TestMinimumBasicScenario-113193968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-5884e44f-d996-47c8-a02d-e739d3efdccc req-69021384-9f5a-4914-8f12-1fe743b49861 tempest-TestMinimumBasicScenario-113193968 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03958d29-cc53-4942-af7e-3acae05dd4c6', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:08:41 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-5884e44f-d996-47c8-a02d-e739d3efdccc req-69021384-9f5a-4914-8f12-1fe743b49861 tempest-TestMinimumBasicScenario-113193968 None] attachment_update completed successfully. Sep 01 02:08:51 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=63,cinder:UPDATE=91,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:51 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=73,cinder:SELECT=63,cinder:INSERT=20,cinder:DELETE=9 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Flow 'volume_create_manager' (3b36bb8f-6b40-4bac-9d7a-db7d4acbe176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1fb7c1-776d-4cbd-bf6d-b01e75c8a99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f1fb7c1-776d-4cbd-bf6d-b01e75c8a99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1802354434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e9ca64-9179-43db-b1ba-2b4884a0f6ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763103490bf84e30a55b10b579e42c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:01Z,use_quota=True,user_id='4fdf102bcca64e2c9f5a19590bc0251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50590d94-36bc-4755-979b-2e4bea11b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50590d94-36bc-4755-979b-2e4bea11b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57eda45-5541-4f59-9e2d-3b9da43c927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d57eda45-5541-4f59-9e2d-3b9da43c927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e9ca64-9179-43db-b1ba-2b4884a0f6ee', 'volume_name': 'volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd862f4-b465-46a5-9e56-5666097ec407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfd862f4-b465-46a5-9e56-5666097ec407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6153ea5a-e1e9-42f8-8a70-8ae299b725c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:01 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Volume a9e9ca64-9179-43db-b1ba-2b4884a0f6ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee', 'volume_size': 1} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1802354434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e9ca64-9179-43db-b1ba-2b4884a0f6ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763103490bf84e30a55b10b579e42c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:01Z,use_quota=True,user_id='4fdf102bcca64e2c9f5a19590bc0251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Creating volume a9e9ca64-9179-43db-b1ba-2b4884a0f6ee {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:01 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:01 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee 1073741824 Sep 01 02:09:01 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:01 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee 1073741824" returned: 0 in 0.618s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:02 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee Sep 01 02:09:02 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:02 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee" returned: 0 in 0.372s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6153ea5a-e1e9-42f8-8a70-8ae299b725c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901fe17f-aaf7-40d0-915f-6686b65866d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:02 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Volume volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee (a9e9ca64-9179-43db-b1ba-2b4884a0f6ee): created successfully Sep 01 02:09:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901fe17f-aaf7-40d0-915f-6686b65866d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Flow 'volume_create_manager' (3b36bb8f-6b40-4bac-9d7a-db7d4acbe176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:02 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fd6cb758-7b9b-45c7-af20-7cffada08296 tempest-VolumesListAdminTestJSON-116564297 None] Created volume successfully. Sep 01 02:09:03 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Flow 'volume_create_manager' (d50f8025-af58-4bd5-ad8e-b8d16d50fc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fe09a0-6860-4750-8758-3dcc20a500c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fe09a0-6860-4750-8758-3dcc20a500c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-869994425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b40509-be91-4913-a911-e225247403fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763103490bf84e30a55b10b579e42c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:04Z,use_quota=True,user_id='4fdf102bcca64e2c9f5a19590bc0251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fef68a-6682-410b-89c7-56a41fb06af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fef68a-6682-410b-89c7-56a41fb06af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e55b26-53e3-417a-9e0e-e9f02371aea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23e55b26-53e3-417a-9e0e-e9f02371aea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b40509-be91-4913-a911-e225247403fc', 'volume_name': 'volume-43b40509-be91-4913-a911-e225247403fc', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7018d7f-b38c-4f01-83a0-0d954efcd68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7018d7f-b38c-4f01-83a0-0d954efcd68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd93f3-6a64-42e0-b1e6-2b924aae7f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:04 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Volume 43b40509-be91-4913-a911-e225247403fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b40509-be91-4913-a911-e225247403fc', 'volume_size': 1} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-869994425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b40509-be91-4913-a911-e225247403fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763103490bf84e30a55b10b579e42c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:04Z,use_quota=True,user_id='4fdf102bcca64e2c9f5a19590bc0251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Creating volume 43b40509-be91-4913-a911-e225247403fc {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:04 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:09:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:04 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc 1073741824 Sep 01 02:09:04 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:05 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc 1073741824" returned: 0 in 0.899s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:05 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc Sep 01 02:09:05 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:05 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc" returned: 0 in 0.314s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92cd93f3-6a64-42e0-b1e6-2b924aae7f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b40509-be91-4913-a911-e225247403fc', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8ce782-ef97-415d-a6da-092136586602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:05 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Volume volume-43b40509-be91-4913-a911-e225247403fc (43b40509-be91-4913-a911-e225247403fc): created successfully Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8ce782-ef97-415d-a6da-092136586602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Flow 'volume_create_manager' (d50f8025-af58-4bd5-ad8e-b8d16d50fc6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:05 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e4f280b1-8cf4-489d-85ee-015c0a011950 tempest-VolumesListAdminTestJSON-116564297 None] Created volume successfully. Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:06 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:09:06 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:06 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.365s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Flow 'volume_create_manager' (d4f63c7c-7e99-45da-b4d0-7393de43f271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cde9cd-5d4b-4e20-ae44-2fa8ee7e3a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cde9cd-5d4b-4e20-ae44-2fa8ee7e3a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-793465722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28b97b3-0d94-43d1-874e-bd3a51619477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763103490bf84e30a55b10b579e42c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:07Z,use_quota=True,user_id='4fdf102bcca64e2c9f5a19590bc0251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46171ca-fe40-4faf-a601-9dce1313ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46171ca-fe40-4faf-a601-9dce1313ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec1fc39-2321-43df-9dd8-c1172af5b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec1fc39-2321-43df-9dd8-c1172af5b72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28b97b3-0d94-43d1-874e-bd3a51619477', 'volume_name': 'volume-f28b97b3-0d94-43d1-874e-bd3a51619477', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5191c69-5a26-45c1-94dc-72d070f1f196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5191c69-5a26-45c1-94dc-72d070f1f196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28c3b64-84cc-4ba2-8b39-7e66c50377db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:06 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Volume f28b97b3-0d94-43d1-874e-bd3a51619477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28b97b3-0d94-43d1-874e-bd3a51619477', 'volume_size': 1} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-793465722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28b97b3-0d94-43d1-874e-bd3a51619477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='763103490bf84e30a55b10b579e42c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:07Z,use_quota=True,user_id='4fdf102bcca64e2c9f5a19590bc0251e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Creating volume f28b97b3-0d94-43d1-874e-bd3a51619477 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:06 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:09:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:06 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 1073741824 Sep 01 02:09:06 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:07 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 1073741824" returned: 0 in 0.787s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:07 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 Sep 01 02:09:07 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:07 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477" returned: 0 in 0.302s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28c3b64-84cc-4ba2-8b39-7e66c50377db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28b97b3-0d94-43d1-874e-bd3a51619477', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b64f6b-74e8-4e9b-9bec-d609095ef83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Volume volume-f28b97b3-0d94-43d1-874e-bd3a51619477 (f28b97b3-0d94-43d1-874e-bd3a51619477): created successfully Sep 01 02:09:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b64f6b-74e8-4e9b-9bec-d609095ef83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Flow 'volume_create_manager' (d4f63c7c-7e99-45da-b4d0-7393de43f271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a0321463-62cf-4275-b64b-4c77622172ee tempest-VolumesListAdminTestJSON-116564297 None] Created volume successfully. Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Flow 'volume_create_manager' (2a898afd-509b-4379-ab00-5b127a386bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab28f947-7723-4de7-9646-806c100bd93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab28f947-7723-4de7-9646-806c100bd93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f405fe1-5f80-43fe-ba1a-a8b05f3c7168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ecbe9fea224eb0b67ad83420551ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:10Z,use_quota=True,user_id='a543453780534a1fa216ac797484c3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7936dbf-0b57-4cce-a326-d027fb85b337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7936dbf-0b57-4cce-a326-d027fb85b337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47725f6-1bfc-4107-83a6-182c5b4dc158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47725f6-1bfc-4107-83a6-182c5b4dc158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f405fe1-5f80-43fe-ba1a-a8b05f3c7168', 'volume_name': 'volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfd4629-c276-4359-b1bd-cfb535eb9ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfd4629-c276-4359-b1bd-cfb535eb9ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1664a389-dc82-4a36-b475-ece892e5026f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Volume 2f405fe1-5f80-43fe-ba1a-a8b05f3c7168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168', 'volume_size': 1} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f405fe1-5f80-43fe-ba1a-a8b05f3c7168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ecbe9fea224eb0b67ad83420551ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:10Z,use_quota=True,user_id='a543453780534a1fa216ac797484c3f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Creating volume 2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:09 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:09:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:09 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 1073741824 Sep 01 02:09:09 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:10 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 1073741824" returned: 0 in 0.658s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:10 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 Sep 01 02:09:10 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:10 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168" returned: 0 in 0.292s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1664a389-dc82-4a36-b475-ece892e5026f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda6bba7-9429-4d61-b0a2-69b19a60dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:10 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Volume volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 (2f405fe1-5f80-43fe-ba1a-a8b05f3c7168): created successfully Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda6bba7-9429-4d61-b0a2-69b19a60dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Flow 'volume_create_manager' (2a898afd-509b-4379-ab00-5b127a386bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-95c23312-7e33-4931-8efb-ffe90285d9cf tempest-VolumesListAdminTestJSON-606211119 None] Created volume successfully. Sep 01 02:09:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Acquiring lock "cinder-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Lock "cinder-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Acquiring lock "cinder-quobyte-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Lock "cinder-quobyte-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3b852f-65b0-41d7-a870-65450d49a387]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "cinder-f28b97b3-0d94-43d1-874e-bd3a51619477-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-f28b97b3-0d94-43d1-874e-bd3a51619477-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "cinder-quobyte-f28b97b3-0d94-43d1-874e-bd3a51619477" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-quobyte-f28b97b3-0d94-43d1-874e-bd3a51619477" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:12 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 Sep 01 02:09:12 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9a2e0e-6838-40ec-aaf4-85a666dc7727]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:12 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 Sep 01 02:09:12 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:12 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168" returned: 0 in 0.695s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:12 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477" returned: 0 in 0.482s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:12 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168 Sep 01 02:09:12 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:12 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477 Sep 01 02:09:12 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:13 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f28b97b3-0d94-43d1-874e-bd3a51619477" returned: 0 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-quobyte-f28b97b3-0d94-43d1-874e-bd3a51619477" released by "delete_volume" :: held 0.963s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:13 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168" returned: 0 in 0.484s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Lock "cinder-quobyte-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168" released by "delete_volume" :: held 1.247s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Created reservations ['442638b2-cfd9-4c13-9b31-effdd766f531', '755b08b4-9bc7-4c50-bf20-4db3426151de', '7b3043a1-1619-423e-9137-4b0b3b7a7bf1', '402587ab-8d10-48d2-bb81-749da412ed67'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Created reservations ['f6045138-2452-4ce7-a925-737d0d0ad38e', 'fda1a90d-d4bf-42a0-87cb-63a5c329c1ae', 'f701ce20-ce10-4701-80ca-05b845df503a', '2fa3eac6-c5bd-42e2-b216-a59946555c81'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:13 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:09:13 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:13 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:09:13 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:14 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.366s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Deleted volume successfully. Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-562b54da-ed71-4bbb-adf1-f113630872b8 tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-f28b97b3-0d94-43d1-874e-bd3a51619477-delete_volume" released by "delete_volume" :: held 1.914s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:14 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.344s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Deleted volume successfully. Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4f3e4615-9fde-46c8-85d4-44a92cc7c5be tempest-VolumesListAdminTestJSON-606211119 None] Lock "cinder-2f405fe1-5f80-43fe-ba1a-a8b05f3c7168-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "cinder-43b40509-be91-4913-a911-e225247403fc-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-43b40509-be91-4913-a911-e225247403fc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "cinder-quobyte-43b40509-be91-4913-a911-e225247403fc" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-quobyte-43b40509-be91-4913-a911-e225247403fc" acquired by "delete_volume" :: waited 0.036s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38d74ff-d7ca-4e41-b37d-91114e5809c0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:15 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc Sep 01 02:09:15 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:15 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc" returned: 0 in 0.433s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:15 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc Sep 01 02:09:15 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:15 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-43b40509-be91-4913-a911-e225247403fc" returned: 0 in 0.295s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-quobyte-43b40509-be91-4913-a911-e225247403fc" released by "delete_volume" :: held 0.782s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Created reservations ['889cc9c0-6573-477f-9f34-0de812fe66d1', 'e3a5ca4e-e5b1-439d-ba31-ff3a186e1e4e', '0ce18912-37fd-44e3-8b8e-2b6a5217e74a', 'a05906f2-4ad7-4940-911a-aae774e1779e'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:15 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:09:15 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "cinder-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:16 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.420s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Deleted volume successfully. Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5e7ee503-d18a-4cd6-adc0-249c9546a279 tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-43b40509-be91-4913-a911-e225247403fc-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "cinder-quobyte-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-quobyte-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[49876a20-bc52-4c7d-a040-c21db342ddda]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:16 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee Sep 01 02:09:16 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:16 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee" returned: 0 in 0.423s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:16 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee Sep 01 02:09:16 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee" returned: 0 in 0.325s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-quobyte-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee" released by "delete_volume" :: held 0.812s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Created reservations ['1bc71c5c-a5b0-49f8-a71c-53086e883ef2', '74603028-c617-4733-91dd-2ee154a4f0db', '11878855-0be3-4b08-86eb-297c023d7de0', '4c0d9b41-bff9-45b8-a43f-0d5e809b7a91'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:17 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:09:17 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.325s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Deleted volume successfully. Sep 01 02:09:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d45c20c0-5e1f-48de-b7a7-a5ac8e604b0d tempest-VolumesListAdminTestJSON-116564297 None] Lock "cinder-a9e9ca64-9179-43db-b1ba-2b4884a0f6ee-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Flow 'volume_create_manager' (a0da1d26-b77c-4cce-91fa-d0361f758300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404a51fa-91d7-450d-a6bc-31af3d48484d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404a51fa-91d7-450d-a6bc-31af3d48484d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1089307807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870fe461-3af1-41de-ab06-13c8c5f6f7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f3e0f9bb1a4173a507d18279d4a862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:25Z,use_quota=True,user_id='bbb28a1f9a2f4d79a333d6fd5c409a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d410963-fcbf-486e-bcd3-11ae88aba094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d410963-fcbf-486e-bcd3-11ae88aba094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3356779-a9a6-4218-a652-3211ba2e5a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3356779-a9a6-4218-a652-3211ba2e5a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870fe461-3af1-41de-ab06-13c8c5f6f7bc', 'volume_name': 'volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f7cb0f-b7f2-4745-8b69-eb8f21e95ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f7cb0f-b7f2-4745-8b69-eb8f21e95ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f537bf-aa31-4b5f-b460-83239dd0459e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:25 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Volume 870fe461-3af1-41de-ab06-13c8c5f6f7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc', 'volume_size': 1} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1089307807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870fe461-3af1-41de-ab06-13c8c5f6f7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f3e0f9bb1a4173a507d18279d4a862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:25Z,use_quota=True,user_id='bbb28a1f9a2f4d79a333d6fd5c409a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Creating volume 870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:25 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc 1073741824 Sep 01 02:09:25 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc 1073741824" returned: 0 in 0.526s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:26 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc Sep 01 02:09:26 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:26 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc" returned: 0 in 0.302s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f537bf-aa31-4b5f-b460-83239dd0459e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0222b84-3f23-4dc1-9e45-9aeb37284e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:26 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Volume volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc (870fe461-3af1-41de-ab06-13c8c5f6f7bc): created successfully Sep 01 02:09:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0222b84-3f23-4dc1-9e45-9aeb37284e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Flow 'volume_create_manager' (a0da1d26-b77c-4cce-91fa-d0361f758300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7d266571-4d58-48a8-947a-1510a5f1c7ab tempest-VolumesDeleteCascade-608490728 None] Created volume successfully. Sep 01 02:09:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Creating offline snapshot 3dfe4797-3aa1-4802-905b-a1a5c1f519d1 of volume 870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:27 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8159289a-9bba-4ff1-937d-0e040b72cea0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc Sep 01 02:09:27 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc" returned: 0 in 0.417s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 1G Sep 01 02:09:28 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 1G" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 Sep 01 02:09:28 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1" returned: 0 in 0.405s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 is being set with open permissions: ugo+rw Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 Sep 01 02:09:29 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Flow 'volume_create_manager' (c5f9e221-cbc6-46b9-8f14-07fc0237d648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a12a10e-576d-4182-beb4-ce66b516e309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a12a10e-576d-4182-beb4-ce66b516e309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1101473959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8ecf6d-068b-44c0-bf8a-532ab010b3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c3c4b8d5964e83ba77092dd0dda39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:29Z,use_quota=True,user_id='429053f9915141c8aba0382b733d1801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ab7fa2-7ecb-4825-ba60-d204131cf6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ab7fa2-7ecb-4825-ba60-d204131cf6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b84ade-7b44-487a-8339-b69ba45221d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39b84ade-7b44-487a-8339-b69ba45221d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8ecf6d-068b-44c0-bf8a-532ab010b3a7', 'volume_name': 'volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c84924-3809-4d3a-b4da-10ed7e3a7c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c84924-3809-4d3a-b4da-10ed7e3a7c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5eba18-fb9e-4cb9-8081-7f76a6bcd5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Volume ba8ecf6d-068b-44c0-bf8a-532ab010b3a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7', 'volume_size': 1} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:29 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1" returned: 0 in 0.257s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.info Sep 01 02:09:29 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.info" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.info is being set with open permissions: ugo+rw Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.info Sep 01 02:09:29 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.info" returned: 0 in 0.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.731s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1101473959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8ecf6d-068b-44c0-bf8a-532ab010b3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c3c4b8d5964e83ba77092dd0dda39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:29Z,use_quota=True,user_id='429053f9915141c8aba0382b733d1801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Creating volume ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:29 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:09:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack sudo[96064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 1073741824 Sep 01 02:09:30 devstack sudo[96064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-bb922de4-03e1-41e9-9041-6465aefd8037 tempest-VolumesDeleteCascade-608490728 None] Create snapshot completed successfully Sep 01 02:09:30 devstack sudo[96064]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 1073741824" returned: 0 in 0.451s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 Sep 01 02:09:30 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7" returned: 0 in 0.259s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b5eba18-fb9e-4cb9-8081-7f76a6bcd5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14325a66-a3cb-443f-ac16-d543bab7fa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:30 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Volume volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 (ba8ecf6d-068b-44c0-bf8a-532ab010b3a7): created successfully Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14325a66-a3cb-443f-ac16-d543bab7fa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Flow 'volume_create_manager' (c5f9e221-cbc6-46b9-8f14-07fc0237d648) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-72864ea2-628e-4024-a6d9-999ddbef91dd tempest-AttachVolumeTestJSON-2025450295 None] Created volume successfully. Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Creating offline snapshot 56eee966-77b0-49a2-b51f-ea8a8b2b4f64 of volume 870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c9d996-1ceb-417c-882c-fd63d5db553e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 Sep 01 02:09:31 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1" returned: 0 in 0.427s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 1G Sep 01 02:09:31 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-7a2ebee6-5960-4cc6-9680-22940c63705b req-ae331532-5d11-4e86-b3ff-f193fb44030c tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:32 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 1G" returned: 0 in 0.493s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 Sep 01 02:09:32 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64" returned: 0 in 0.293s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 is being set with open permissions: ugo+rw Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 Sep 01 02:09:32 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64" returned: 0 in 0.266s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.585s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-7a2ebee6-5960-4cc6-9680-22940c63705b req-ae331532-5d11-4e86-b3ff-f193fb44030c tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.675s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-7a2ebee6-5960-4cc6-9680-22940c63705b req-ae331532-5d11-4e86-b3ff-f193fb44030c tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c870f689-6abb-42ff-ac5c-e4a04724a975 tempest-VolumesDeleteCascade-608490728 None] Create snapshot completed successfully Sep 01 02:09:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-7a2ebee6-5960-4cc6-9680-22940c63705b req-ae331532-5d11-4e86-b3ff-f193fb44030c tempest-AttachVolumeTestJSON-2025450295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec00a12b-0360-4cc4-a6a0-aefd318de01c', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:09:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-7a2ebee6-5960-4cc6-9680-22940c63705b req-ae331532-5d11-4e86-b3ff-f193fb44030c tempest-AttachVolumeTestJSON-2025450295 None] attachment_update completed successfully. Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-870fe461-3af1-41de-ab06-13c8c5f6f7bc-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-870fe461-3af1-41de-ab06-13c8c5f6f7bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Performing cascade delete. {{(pid=87425) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-3dfe4797-3aa1-4802-905b-a1a5c1f519d1-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-3dfe4797-3aa1-4802-905b-a1a5c1f519d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-3dfe4797-3aa1-4802-905b-a1a5c1f519d1" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-3dfe4797-3aa1-4802-905b-a1a5c1f519d1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Deleting offline snapshot 3dfe4797-3aa1-4802-905b-a1a5c1f519d1 of volume 870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] snapshot_file for this snap is: volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[16277545-b43a-45c0-87d7-779fa546804d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:33 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 Sep 01 02:09:33 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:33 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1" returned: 0 in 0.381s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fea014-fbb9-412c-b0c7-be824db83a92]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc Sep 01 02:09:34 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc" returned: 0 in 0.486s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9fddd4-3ba2-4d36-b8eb-aa8c63fd74a8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 Sep 01 02:09:34 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64" returned: 0 in 0.483s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca92320-e7cc-4352-a53c-684de98e418f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 Sep 01 02:09:35 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1" returned: 0 in 0.422s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:35 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce4468-c061-4d46-887b-1b0683921c3e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc Sep 01 02:09:35 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc" returned: 0 in 0.408s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 Sep 01 02:09:35 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1" returned: 0 in 0.436s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1 Sep 01 02:09:36 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.3dfe4797-3aa1-4802-905b-a1a5c1f519d1" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 -F qcow2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 -F qcow2 Sep 01 02:09:36 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 -F qcow2" returned: 0 in 0.372s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-3dfe4797-3aa1-4802-905b-a1a5c1f519d1" released by "_delete_snapshot" :: held 3.559s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" released by "delete_snapshot" :: held 3.605s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Created reservations ['bdbaded0-14c8-465e-8ebf-f0223de88015', '8176ce3c-cc70-4c7f-8291-07a96e3f7eb7', '15b1a429-c2f7-4c3c-b879-75459180c569', 'e45648f1-c06e-4efd-9316-63d61029ced7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Delete snapshot completed successfully. Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-3dfe4797-3aa1-4802-905b-a1a5c1f519d1-delete_snapshot" released by "delete_snapshot" :: held 3.864s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-56eee966-77b0-49a2-b51f-ea8a8b2b4f64-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-56eee966-77b0-49a2-b51f-ea8a8b2b4f64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-56eee966-77b0-49a2-b51f-ea8a8b2b4f64" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-56eee966-77b0-49a2-b51f-ea8a8b2b4f64" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Deleting offline snapshot 56eee966-77b0-49a2-b51f-ea8a8b2b4f64 of volume 870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] snapshot_file for this snap is: volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[26179e88-f10e-44fd-bcd9-d2d3c7271925]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:37 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 Sep 01 02:09:37 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:37 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64" returned: 0 in 0.521s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d9e6de-8754-49c2-8891-294b4e6436fe]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:38 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc Sep 01 02:09:38 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:38 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc" returned: 0 in 0.565s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:38 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 Sep 01 02:09:38 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:39 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64" returned: 0 in 0.691s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:39 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64 Sep 01 02:09:39 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:39 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc.56eee966-77b0-49a2-b51f-ea8a8b2b4f64" returned: 0 in 0.373s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-56eee966-77b0-49a2-b51f-ea8a8b2b4f64" released by "_delete_snapshot" :: held 2.278s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" released by "delete_snapshot" :: held 2.319s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Created reservations ['eb1a2c63-ce4e-4c40-9e51-44a53bd694df', 'dec5e71b-5843-4618-b866-84ab0ba3e838', 'cba976ea-5983-451e-9c36-5ce3fc828774', 'c646c189-2800-4d59-9944-b9a4d0653f93'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Delete snapshot completed successfully. Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-56eee966-77b0-49a2-b51f-ea8a8b2b4f64-delete_snapshot" released by "delete_snapshot" :: held 2.570s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Snapshots deleted, issuing volume delete {{(pid=87425) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e036969b-525b-4c0d-99a6-f3330ed37b98]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:40 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc Sep 01 02:09:40 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:40 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc" returned: 0 in 0.461s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:40 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc Sep 01 02:09:40 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:40 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-870fe461-3af1-41de-ab06-13c8c5f6f7bc" returned: 0 in 0.301s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-870fe461-3af1-41de-ab06-13c8c5f6f7bc" released by "delete_volume" :: held 0.881s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Created reservations ['00e64575-101c-4b43-8abe-3e2f06b1588b', '2d8aff52-4902-4368-ad3a-17f314ef1501', 'e6f262a0-41b8-4df2-a857-6f17ede76e08', 'acb8b579-4352-42a8-b7ca-73138b6390d1'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:40 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:09:40 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:41 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.322s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:41 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Deleted volume successfully. Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1a493166-3580-4b7c-ac1a-a6c9a3721f5b tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-870fe461-3af1-41de-ab06-13c8c5f6f7bc-delete_volume" released by "delete_volume" :: held 8.000s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Flow 'volume_create_manager' (30f2fd1f-c7f5-49b9-8fdd-a3c41f2bb23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a7c5d2-4952-481d-a183-2e53091a42da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a7c5d2-4952-481d-a183-2e53091a42da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1468907233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e711959-e380-42a3-9be7-af14b36fa314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f3e0f9bb1a4173a507d18279d4a862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:42Z,use_quota=True,user_id='bbb28a1f9a2f4d79a333d6fd5c409a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f79453-cef4-4851-9f9e-14380fd158e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f79453-cef4-4851-9f9e-14380fd158e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d744a4-b0d4-4f33-b1f4-1a82c41d5bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d744a4-b0d4-4f33-b1f4-1a82c41d5bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e711959-e380-42a3-9be7-af14b36fa314', 'volume_name': 'volume-9e711959-e380-42a3-9be7-af14b36fa314', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae93d44-cd3a-48b0-83e1-803e4ad3a050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae93d44-cd3a-48b0-83e1-803e4ad3a050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59144768-6040-496d-8893-8bbd68c555fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:41 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Volume 9e711959-e380-42a3-9be7-af14b36fa314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e711959-e380-42a3-9be7-af14b36fa314', 'volume_size': 1} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1468907233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e711959-e380-42a3-9be7-af14b36fa314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f3e0f9bb1a4173a507d18279d4a862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:42Z,use_quota=True,user_id='bbb28a1f9a2f4d79a333d6fd5c409a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Creating volume 9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:41 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:09:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:41 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 1073741824 Sep 01 02:09:41 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 1073741824" returned: 0 in 0.530s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:42 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 Sep 01 02:09:42 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314" returned: 0 in 0.276s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59144768-6040-496d-8893-8bbd68c555fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e711959-e380-42a3-9be7-af14b36fa314', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ba2534-a992-40de-893f-55abf714d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:42 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Volume volume-9e711959-e380-42a3-9be7-af14b36fa314 (9e711959-e380-42a3-9be7-af14b36fa314): created successfully Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1ba2534-a992-40de-893f-55abf714d27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Flow 'volume_create_manager' (30f2fd1f-c7f5-49b9-8fdd-a3c41f2bb23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d336fb6c-5563-4ab6-9264-59a407d288f0 tempest-VolumesDeleteCascade-608490728 None] Created volume successfully. Sep 01 02:09:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Creating offline snapshot f13eeb61-3aac-44a6-b582-6a2122d5af3a of volume 9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:44 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7f60e7-8e2d-4f63-b37b-17596685d9d0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 Sep 01 02:09:44 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314" returned: 0 in 0.450s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a 1G Sep 01 02:09:44 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a 1G" returned: 0 in 0.479s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e711959-e380-42a3-9be7-af14b36fa314 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e711959-e380-42a3-9be7-af14b36fa314 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a Sep 01 02:09:45 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e711959-e380-42a3-9be7-af14b36fa314 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a" returned: 0 in 0.311s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a is being set with open permissions: ugo+rw Sep 01 02:09:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a Sep 01 02:09:45 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a" returned: 0 in 0.264s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.info Sep 01 02:09:45 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.info" returned: 0 in 0.314s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.info is being set with open permissions: ugo+rw Sep 01 02:09:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.info Sep 01 02:09:46 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.info" returned: 0 in 0.275s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e002dd34-5249-4b4d-81e6-a04a74c9524b tempest-VolumesDeleteCascade-608490728 None] Create snapshot completed successfully Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Flow 'volume_create_manager' (f402d0bf-6657-4f58-866d-d00effc58ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e947bde7-6382-41a0-8146-188450093ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e947bde7-6382-41a0-8146-188450093ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-185388265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cc31c65-1938-40ae-b2b4-6e7746935a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f3e0f9bb1a4173a507d18279d4a862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f13eeb61-3aac-44a6-b582-6a2122d5af3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:48Z,use_quota=True,user_id='bbb28a1f9a2f4d79a333d6fd5c409a51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e311a8f7-27e8-4057-a650-09d47f2db932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e311a8f7-27e8-4057-a650-09d47f2db932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcded0a-8d97-4a69-96ea-4bad3616a8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dcded0a-8d97-4a69-96ea-4bad3616a8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5cc31c65-1938-40ae-b2b4-6e7746935a70', 'volume_name': 'volume-5cc31c65-1938-40ae-b2b4-6e7746935a70', 'volume_size': 1, 'snapshot_id': 'f13eeb61-3aac-44a6-b582-6a2122d5af3a'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41db26c-92ea-4386-94d7-92d6485e23f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41db26c-92ea-4386-94d7-92d6485e23f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5657ff20-a332-49f9-b295-b4af87e9c319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:48 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Volume 5cc31c65-1938-40ae-b2b4-6e7746935a70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5cc31c65-1938-40ae-b2b4-6e7746935a70', 'volume_size': 1, 'snapshot_id': 'f13eeb61-3aac-44a6-b582-6a2122d5af3a'} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-f13eeb61-3aac-44a6-b582-6a2122d5af3a-5cc31c65-1938-40ae-b2b4-6e7746935a70" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-f13eeb61-3aac-44a6-b582-6a2122d5af3a-5cc31c65-1938-40ae-b2b4-6e7746935a70" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Creating volume 5cc31c65-1938-40ae-b2b4-6e7746935a70 from snapshot f13eeb61-3aac-44a6-b582-6a2122d5af3a {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-5cc31c65-1938-40ae-b2b4-6e7746935a70" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-5cc31c65-1938-40ae-b2b4-6e7746935a70" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] snapshot: f13eeb61-3aac-44a6-b582-6a2122d5af3a, volume: 5cc31c65-1938-40ae-b2b4-6e7746935a70, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cde6b4-88d7-46d6-9343-b2aca3a0bfc4]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:48 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a Sep 01 02:09:48 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:48 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a" returned: 0 in 0.422s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e711959-e380-42a3-9be7-af14b36fa314(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc90c5-6c70-49ba-aa2d-9b9242b2446f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:48 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 Sep 01 02:09:48 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314" returned: 0 in 0.403s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:09:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:09:49 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:09:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 Sep 01 02:09:49 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:55 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70" returned: 0 in 6.343s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:09:55 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Converted 1024.00 MB image at 161.37 MB/s Sep 01 02:09:55 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 is being set with open permissions: ugo+rw Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:55 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 Sep 01 02:09:55 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:55 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70" returned: 0 in 0.320s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-5cc31c65-1938-40ae-b2b4-6e7746935a70" released by "_copy_volume_from_snapshot" :: held 7.578s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=75,cinder:UPDATE=77,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=81,cinder:SELECT=62,cinder:INSERT=20,cinder:DELETE=8 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-f13eeb61-3aac-44a6-b582-6a2122d5af3a-5cc31c65-1938-40ae-b2b4-6e7746935a70" released by "_create_volume_from_snapshot" :: held 7.669s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.689s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5657ff20-a332-49f9-b295-b4af87e9c319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cc31c65-1938-40ae-b2b4-6e7746935a70', 'volume_size': 1, 'snapshot_id': 'f13eeb61-3aac-44a6-b582-6a2122d5af3a'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b1b2e6-187e-4373-ba20-887ea6b946b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:55 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Volume volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 (5cc31c65-1938-40ae-b2b4-6e7746935a70): created successfully Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b1b2e6-187e-4373-ba20-887ea6b946b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Flow 'volume_create_manager' (f402d0bf-6657-4f58-866d-d00effc58ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cab85469-1565-4071-8bcd-b1283202160f tempest-VolumesDeleteCascade-608490728 None] Created volume successfully. Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-9e711959-e380-42a3-9be7-af14b36fa314-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-9e711959-e380-42a3-9be7-af14b36fa314-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Performing cascade delete. {{(pid=87425) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-f13eeb61-3aac-44a6-b582-6a2122d5af3a-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-f13eeb61-3aac-44a6-b582-6a2122d5af3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-9e711959-e380-42a3-9be7-af14b36fa314" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-9e711959-e380-42a3-9be7-af14b36fa314" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-f13eeb61-3aac-44a6-b582-6a2122d5af3a" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-f13eeb61-3aac-44a6-b582-6a2122d5af3a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Deleting offline snapshot f13eeb61-3aac-44a6-b582-6a2122d5af3a of volume 9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] snapshot_file for this snap is: volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc85bca-2ec6-4796-b5bd-795a3e6b15ce]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:56 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a Sep 01 02:09:56 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-6c8ad296-d8de-4f19-9aea-74bf7f241a2e req-acc9e1a7-7964-4c9d-826c-74fea128d285 tempest-TestMinimumBasicScenario-113193968 None] Terminate volume connection completed successfully. Sep 01 02:09:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-6c8ad296-d8de-4f19-9aea-74bf7f241a2e req-acc9e1a7-7964-4c9d-826c-74fea128d285 tempest-TestMinimumBasicScenario-113193968 None] Deleting attachment 03958d29-cc53-4942-af7e-3acae05dd4c6. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:09:57 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a" returned: 0 in 0.459s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e711959-e380-42a3-9be7-af14b36fa314(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:57 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[de158b2d-1a08-4e4a-ad85-df718df39d99]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:57 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 Sep 01 02:09:57 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:57 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314" returned: 0 in 0.582s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:57 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a Sep 01 02:09:57 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Acquiring lock "cinder-31ff3a04-600d-4a6f-9196-9b42c2d2d404-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Lock "cinder-31ff3a04-600d-4a6f-9196-9b42c2d2d404-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Acquiring lock "cinder-quobyte-31ff3a04-600d-4a6f-9196-9b42c2d2d404" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Lock "cinder-quobyte-31ff3a04-600d-4a6f-9196-9b42c2d2d404" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb64a89f-d904-4101-ad93-3a3f700aa0a6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a" returned: 0 in 0.423s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a Sep 01 02:09:58 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:58 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 Sep 01 02:09:58 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:58 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314.f13eeb61-3aac-44a6-b582-6a2122d5af3a" returned: 0 in 0.292s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-f13eeb61-3aac-44a6-b582-6a2122d5af3a" released by "_delete_snapshot" :: held 1.868s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-9e711959-e380-42a3-9be7-af14b36fa314" released by "delete_snapshot" :: held 1.901s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:58 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404" returned: 0 in 0.431s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404 Sep 01 02:09:58 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Created reservations ['77b55b3b-3971-4fac-875a-055c5a9ff32c', 'e0a2734f-4eef-4980-be18-ac9668f884e1', '6426a0f8-d619-48fa-8732-2bf8037900a8', '21924847-24dd-48e4-b32a-433581786ce2'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:58 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Delete snapshot completed successfully. Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-f13eeb61-3aac-44a6-b582-6a2122d5af3a-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Snapshots deleted, issuing volume delete {{(pid=87425) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-9e711959-e380-42a3-9be7-af14b36fa314" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-9e711959-e380-42a3-9be7-af14b36fa314" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5b728-b05c-443f-823c-718735f8b072]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-31ff3a04-600d-4a6f-9196-9b42c2d2d404" returned: 0 in 0.316s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Lock "cinder-quobyte-31ff3a04-600d-4a6f-9196-9b42c2d2d404" released by "delete_volume" :: held 0.795s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:58 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 Sep 01 02:09:58 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Created reservations ['fa2f830f-cdbb-4bdc-b7ee-c7f6e9d49719', '84ced482-b315-4257-9105-8c3e692bdbf7', '853ffeb4-bb2d-49fd-9052-1a7446af54e5', '65e16da1-cf5a-44dd-a3be-a4aa65669770'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:58 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:59 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:09:59 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:59 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314" returned: 0 in 0.475s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:59 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314 Sep 01 02:09:59 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:59 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.333s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Deleted volume successfully. Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8bd7b5f9-3133-466f-b45e-77eb5b64907f tempest-TestMinimumBasicScenario-113193968 None] Lock "cinder-31ff3a04-600d-4a6f-9196-9b42c2d2d404-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:59 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9e711959-e380-42a3-9be7-af14b36fa314" returned: 0 in 0.403s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-9e711959-e380-42a3-9be7-af14b36fa314" released by "delete_volume" :: held 0.960s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:59 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Created reservations ['54985b8e-5a1d-4dbc-a570-49643d747862', 'bc9d5d21-2142-4863-9f6c-1d15e9734215', 'd7136d16-fab1-4fb7-acc4-02c547350240', 'd2fde4b4-5501-428b-9531-7e7b428d60d5'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:00 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:10:00 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:00 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.300s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Deleted volume successfully. Sep 01 02:10:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33942177-4272-43bb-af0e-c4e654883cd3 tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-9e711959-e380-42a3-9be7-af14b36fa314-delete_volume" released by "delete_volume" :: held 3.976s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-5cc31c65-1938-40ae-b2b4-6e7746935a70-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-5cc31c65-1938-40ae-b2b4-6e7746935a70-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "cinder-quobyte-5cc31c65-1938-40ae-b2b4-6e7746935a70" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-5cc31c65-1938-40ae-b2b4-6e7746935a70" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2768a-5224-4c6f-9b38-7bdbcf8118ae]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 Sep 01 02:10:01 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70" returned: 0 in 0.470s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70 Sep 01 02:10:01 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:02 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5cc31c65-1938-40ae-b2b4-6e7746935a70" returned: 0 in 0.316s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-quobyte-5cc31c65-1938-40ae-b2b4-6e7746935a70" released by "delete_volume" :: held 0.845s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Created reservations ['d79cee8e-8a67-435d-bfc7-fcabd544b94f', 'a8b5b954-b636-4d68-9d6b-a2d9b7731187', 'bdae87f1-5604-4cc5-b965-cb01efa0fbb8', 'a7df9b04-ec2f-443a-ad37-03c634ac05dc'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:02 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:10:02 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:02 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.356s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:02 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Deleted volume successfully. Sep 01 02:10:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c6442d06-2e06-4f4f-aba2-874fa52eea0f tempest-VolumesDeleteCascade-608490728 None] Lock "cinder-5cc31c65-1938-40ae-b2b4-6e7746935a70-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:06 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:10:06 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:06 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.327s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:10:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:10:12 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=30,cinder:DELETE=1,cinder:SELECT=22,cinder:INSERT=9 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:12 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-d3026db7-f881-4087-8e34-a6f921e9c6fe req-4eb10e2d-7e51-4043-b19a-7f8d88d17a5b tempest-AttachVolumeTestJSON-2025450295 None] Terminate volume connection completed successfully. Sep 01 02:10:17 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-d3026db7-f881-4087-8e34-a6f921e9c6fe req-4eb10e2d-7e51-4043-b19a-7f8d88d17a5b tempest-AttachVolumeTestJSON-2025450295 None] Deleting attachment ec00a12b-0360-4cc4-a6a0-aefd318de01c. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Flow 'volume_create_manager' (c06b9188-ff08-4076-8f32-6c74aa5da051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc1297f-d86b-4983-8c8d-d43bc9c3476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc1297f-d86b-4983-8c8d-d43bc9c3476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1207657461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b630ca8b-aa7c-4667-bd08-b31569caa72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d06795ca994ec8ad5f5d39b946a22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:21Z,use_quota=True,user_id='86bb60882a5845cfb40a76cc67364442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012ac0d0-874a-44ee-b0ae-5315f8d0d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012ac0d0-874a-44ee-b0ae-5315f8d0d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9c9f5d-1806-4703-8727-2b690ec8ff81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9c9f5d-1806-4703-8727-2b690ec8ff81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b630ca8b-aa7c-4667-bd08-b31569caa72e', 'volume_name': 'volume-b630ca8b-aa7c-4667-bd08-b31569caa72e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e867f5b-2f4f-4994-b980-45b6de5e2ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e867f5b-2f4f-4994-b980-45b6de5e2ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46ef1d7-387a-4d4f-aebb-48d5f44c3273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:21 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Volume b630ca8b-aa7c-4667-bd08-b31569caa72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b630ca8b-aa7c-4667-bd08-b31569caa72e', 'volume_size': 1} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1207657461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b630ca8b-aa7c-4667-bd08-b31569caa72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d06795ca994ec8ad5f5d39b946a22b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:21Z,use_quota=True,user_id='86bb60882a5845cfb40a76cc67364442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Creating volume b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:21 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:21 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e 1073741824 Sep 01 02:10:21 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:21 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e 1073741824" returned: 0 in 0.591s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:21 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:10:21 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:22 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.401s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46ef1d7-387a-4d4f-aebb-48d5f44c3273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b630ca8b-aa7c-4667-bd08-b31569caa72e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da110240-e01d-4b9e-ad4b-2a926b6b5932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Volume volume-b630ca8b-aa7c-4667-bd08-b31569caa72e (b630ca8b-aa7c-4667-bd08-b31569caa72e): created successfully Sep 01 02:10:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da110240-e01d-4b9e-ad4b-2a926b6b5932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Flow 'volume_create_manager' (c06b9188-ff08-4076-8f32-6c74aa5da051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9aa825a6-6645-49c5-8b42-6849a44d91bb tempest-VolumesActionsTest-323385402 None] Created volume successfully. Sep 01 02:10:32 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:32 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:38 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-380ef1d7-b309-40a2-9e59-1d09b047c0a8 tempest-VolumesActionsTest-323385402 None] Acquiring lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e" by "attach_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-380ef1d7-b309-40a2-9e59-1d09b047c0a8 tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e" acquired by "attach_volume" :: waited 0.033s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-380ef1d7-b309-40a2-9e59-1d09b047c0a8 tempest-VolumesActionsTest-323385402 None] Attaching volume b630ca8b-aa7c-4667-bd08-b31569caa72e to instance 134603c9-71b4-471e-bc32-bab0b16be516 at mountpoint /dev/vdb on host None. Sep 01 02:10:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-380ef1d7-b309-40a2-9e59-1d09b047c0a8 tempest-VolumesActionsTest-323385402 None] Attach volume completed successfully. Sep 01 02:10:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-380ef1d7-b309-40a2-9e59-1d09b047c0a8 tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e" released by "attach_volume" :: held 0.147s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1f3e748b-dbe0-4d91-8e50-4e2e5e7dbead tempest-VolumesActionsTest-323385402 None] Acquiring lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-detach_volume" by "detach_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1f3e748b-dbe0-4d91-8e50-4e2e5e7dbead tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1f3e748b-dbe0-4d91-8e50-4e2e5e7dbead tempest-VolumesActionsTest-323385402 None] Detaching volume b630ca8b-aa7c-4667-bd08-b31569caa72e from instance 134603c9-71b4-471e-bc32-bab0b16be516. Sep 01 02:10:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1f3e748b-dbe0-4d91-8e50-4e2e5e7dbead tempest-VolumesActionsTest-323385402 None] Detach volume completed successfully. Sep 01 02:10:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1f3e748b-dbe0-4d91-8e50-4e2e5e7dbead tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:49 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=2,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:49 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=11,cinder:INSERT=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Flow 'volume_create_manager' (40ea38d7-abb4-49d4-854d-ef585652a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849cb89d-aa25-4573-80da-40dc935286cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849cb89d-aa25-4573-80da-40dc935286cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1218906034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f7352c-e25e-455b-b3d6-e623f8ebfcdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4730d29cb6154913adb30ae6c5d56263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:52Z,use_quota=True,user_id='e14a688fbba2497db2ace21389f15d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3778e97b-cbd6-4bd4-beca-cd592c81d53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3778e97b-cbd6-4bd4-beca-cd592c81d53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287d1577-eb0c-4fde-8a47-e4d9f82891d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287d1577-eb0c-4fde-8a47-e4d9f82891d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f7352c-e25e-455b-b3d6-e623f8ebfcdb', 'volume_name': 'volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2325d05-e2dd-4821-a8f9-b712ad5419c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2325d05-e2dd-4821-a8f9-b712ad5419c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa53e3f-39aa-4b4e-8689-fdbbeaab3528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:52 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Volume e3f7352c-e25e-455b-b3d6-e623f8ebfcdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb', 'volume_size': 1} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1218906034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f7352c-e25e-455b-b3d6-e623f8ebfcdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4730d29cb6154913adb30ae6c5d56263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:52Z,use_quota=True,user_id='e14a688fbba2497db2ace21389f15d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Creating volume e3f7352c-e25e-455b-b3d6-e623f8ebfcdb {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:52 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:52 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb 1073741824 Sep 01 02:10:52 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e045d527-b6b6-4a3a-8f33-191a8d39b8e0 tempest-VolumesActionsTest-323385402 None] Acquiring lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e" by "attach_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e045d527-b6b6-4a3a-8f33-191a8d39b8e0 tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e" acquired by "attach_volume" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e045d527-b6b6-4a3a-8f33-191a8d39b8e0 tempest-VolumesActionsTest-323385402 None] Attaching volume b630ca8b-aa7c-4667-bd08-b31569caa72e to instance 153026c6-1349-4d69-aa8f-af7f81b00709 at mountpoint /dev/vdb on host None. Sep 01 02:10:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e045d527-b6b6-4a3a-8f33-191a8d39b8e0 tempest-VolumesActionsTest-323385402 None] Attach volume completed successfully. Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e045d527-b6b6-4a3a-8f33-191a8d39b8e0 tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e" released by "attach_volume" :: held 0.141s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-23281da6-8787-493b-9086-79ca7d4648b4 tempest-VolumesActionsTest-323385402 None] Acquiring lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-detach_volume" by "detach_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-23281da6-8787-493b-9086-79ca7d4648b4 tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-23281da6-8787-493b-9086-79ca7d4648b4 tempest-VolumesActionsTest-323385402 None] Detaching volume b630ca8b-aa7c-4667-bd08-b31569caa72e from instance 153026c6-1349-4d69-aa8f-af7f81b00709. Sep 01 02:10:53 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-23281da6-8787-493b-9086-79ca7d4648b4 tempest-VolumesActionsTest-323385402 None] Detach volume completed successfully. Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-23281da6-8787-493b-9086-79ca7d4648b4 tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:53 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb 1073741824" returned: 0 in 0.664s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:53 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb Sep 01 02:10:53 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" returned: 0 in 0.298s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:53 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fa53e3f-39aa-4b4e-8689-fdbbeaab3528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059a6981-7d25-44ff-bab5-8191c14984ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:53 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Volume volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb (e3f7352c-e25e-455b-b3d6-e623f8ebfcdb): created successfully Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059a6981-7d25-44ff-bab5-8191c14984ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Flow 'volume_create_manager' (40ea38d7-abb4-49d4-854d-ef585652a376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:53 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-03dab74c-0c38-467d-ae7a-1d73534db780 tempest-TestImageHashVerification-1364025620 None] Created volume successfully. Sep 01 02:10:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:55 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071987c-33df-44ed-907c-6aeffba855ad]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:56 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb Sep 01 02:10:56 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:56 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" returned: 0 in 0.398s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:56 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab71af-856f-473f-b411-669805fccfca]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:56 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb Sep 01 02:10:56 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:56 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" returned: 0 in 0.460s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb /opt/stack/data/cinder/conversion/e3f7352c-e25e-455b-b3d6-e623f8ebfcdb.temp_image.5a4e3f80-288e-424b-9e0b-1291c3dc6f1cvy5n54st.img {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:56 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb /opt/stack/data/cinder/conversion/e3f7352c-e25e-455b-b3d6-e623f8ebfcdb.temp_image.5a4e3f80-288e-424b-9e0b-1291c3dc6f1cvy5n54st.img Sep 01 02:10:56 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:01 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb /opt/stack/data/cinder/conversion/e3f7352c-e25e-455b-b3d6-e623f8ebfcdb.temp_image.5a4e3f80-288e-424b-9e0b-1291c3dc6f1cvy5n54st.img" returned: 0 in 4.380s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4fa75f-1742-42d1-b658-602a21438bae]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb Sep 01 02:11:01 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:01 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" returned: 0 in 0.562s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/conversion/e3f7352c-e25e-455b-b3d6-e623f8ebfcdb.temp_image.5a4e3f80-288e-424b-9e0b-1291c3dc6f1cvy5n54st.img {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:11:01 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Converted 1024.00 MB image at 233.72 MB/s Sep 01 02:11:01 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] 5a4e3f80-288e-424b-9e0b-1291c3dc6f1c was raw, no need to convert to raw {{(pid=87425) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:06 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:11:06 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:06 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.301s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:11:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:11:09 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:11 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.973s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Uploaded volume to glance image-id: 5a4e3f80-288e-424b-9e0b-1291c3dc6f1c. {{(pid=87425) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:11:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 26.280s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:25 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32fa23-8e95-4a6d-b6a9-92036f5c2af8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e42b4189-be00-44b4-b012-6d2c265adc06 tempest-TestImageHashVerification-1364025620 None] Copy volume to image completed successfully. Sep 01 02:11:26 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:11:26 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:26 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.446s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d29758b-1841-4949-a531-c3b62fca35bb]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:26 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:11:26 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:26 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.429s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.a2258c77-2456-4d17-a616-6b32efb4bc9choqdampd.img {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:26 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.a2258c77-2456-4d17-a616-6b32efb4bc9choqdampd.img Sep 01 02:11:26 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Acquiring lock "cinder-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Lock "cinder-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Acquiring lock "cinder-quobyte-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Lock "cinder-quobyte-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" acquired by "delete_volume" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:27 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c327186-0d7c-43a0-a653-78fd10e0f5ef]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:27 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb Sep 01 02:11:27 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:28 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" returned: 0 in 0.843s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:28 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb Sep 01 02:11:28 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:28 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" returned: 0 in 0.938s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Lock "cinder-quobyte-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb" released by "delete_volume" :: held 1.859s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:29 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Created reservations ['ce83d724-d5ee-4952-89f8-846fc301eab1', '719951b8-87c3-4cc9-892a-40c113b706fe', '6cd93661-d180-4144-9f28-c5fca94c684e', 'd8bfe0f7-fb7e-4bcb-ab04-63f5147aebb7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:29 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:11:29 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:30 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.965s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:30 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Deleted volume successfully. Sep 01 02:11:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7c3afc8-d06b-4290-a554-60ca8c2ec3cb tempest-TestImageHashVerification-1364025620 None] Lock "cinder-e3f7352c-e25e-455b-b3d6-e623f8ebfcdb-delete_volume" released by "delete_volume" :: held 3.648s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:33 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.a2258c77-2456-4d17-a616-6b32efb4bc9choqdampd.img" returned: 0 in 6.468s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:33 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f51dd7f-1fe6-434c-9a2d-f4d5ac6115ee]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:33 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:11:33 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:33 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.628s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:33 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.a2258c77-2456-4d17-a616-6b32efb4bc9choqdampd.img {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:11:33 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Converted 1024.00 MB image at 158.29 MB/s Sep 01 02:11:33 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] a2258c77-2456-4d17-a616-6b32efb4bc9c was raw, no need to convert to raw {{(pid=87425) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:11:42 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Flow 'volume_create_manager' (b13d2eed-b2fe-420d-9d8e-805f475df255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9465585d-2e16-417f-a560-56be6418285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9465585d-2e16-417f-a560-56be6418285c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-400670060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036f1ecc-f8d7-4214-aaea-3b9e39d5a205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c3c4b8d5964e83ba77092dd0dda39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:43Z,use_quota=True,user_id='429053f9915141c8aba0382b733d1801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53190401-4f8b-44be-95b8-b9741b3a3579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53190401-4f8b-44be-95b8-b9741b3a3579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8d3c49-3a17-4e0f-a52e-5d6a3d23cc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8d3c49-3a17-4e0f-a52e-5d6a3d23cc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036f1ecc-f8d7-4214-aaea-3b9e39d5a205', 'volume_name': 'volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2467851-7cbd-4476-a861-5d0228b4893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2467851-7cbd-4476-a861-5d0228b4893d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c064502d-dd5a-4e82-8713-fd84909130f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:43 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Volume 036f1ecc-f8d7-4214-aaea-3b9e39d5a205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205', 'volume_size': 1} Sep 01 02:11:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (0a085237-5998-4b41-a495-f51b02326957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317b6568-8e63-4b91-afa2-8bd5cf6a7414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317b6568-8e63-4b91-afa2-8bd5cf6a7414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2116064312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a5cc46-b444-4dd9-96dd-074b479dc1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:48Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9489cf-22c9-4455-86a2-a9d60c8c3b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9489cf-22c9-4455-86a2-a9d60c8c3b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087532c4-83bd-452f-8df0-1450cf2bfea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087532c4-83bd-452f-8df0-1450cf2bfea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a5cc46-b444-4dd9-96dd-074b479dc1db', 'volume_name': 'volume-54a5cc46-b444-4dd9-96dd-074b479dc1db', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43bf468-9780-4b02-83d9-9c510b81c000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b43bf468-9780-4b02-83d9-9c510b81c000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9c6fe-8402-4262-99ff-3c35d79ab931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume 54a5cc46-b444-4dd9-96dd-074b479dc1db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a5cc46-b444-4dd9-96dd-074b479dc1db', 'volume_size': 1} Sep 01 02:11:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.230s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Uploaded volume to glance image-id: a2258c77-2456-4d17-a616-6b32efb4bc9c. {{(pid=87425) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-400670060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036f1ecc-f8d7-4214-aaea-3b9e39d5a205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c3c4b8d5964e83ba77092dd0dda39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:43Z,use_quota=True,user_id='429053f9915141c8aba0382b733d1801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Creating volume 036f1ecc-f8d7-4214-aaea-3b9e39d5a205 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:56 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:56 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 1073741824 Sep 01 02:11:56 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-232e7f84-8ff6-4e7e-9e57-6ce7fa28cb84 tempest-VolumesActionsTest-323385402 None] Copy volume to image completed successfully. Sep 01 02:11:56 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 1073741824" returned: 0 in 0.568s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:56 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 Sep 01 02:11:56 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:57 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.804s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2116064312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a5cc46-b444-4dd9-96dd-074b479dc1db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:48Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Creating volume 54a5cc46-b444-4dd9-96dd-074b479dc1db {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:57 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c064502d-dd5a-4e82-8713-fd84909130f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:57 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db 1073741824 Sep 01 02:11:57 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0318b10-7a71-4844-8ec9-ea07b1385929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Volume volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 (036f1ecc-f8d7-4214-aaea-3b9e39d5a205): created successfully Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0318b10-7a71-4844-8ec9-ea07b1385929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Flow 'volume_create_manager' (b13d2eed-b2fe-420d-9d8e-805f475df255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-95d9b35f-cdea-4e89-902c-b2fb962de3cb tempest-AttachVolumeTestJSON-2025450295 None] Created volume successfully. Sep 01 02:11:57 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db 1073741824" returned: 0 in 0.531s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:57 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db Sep 01 02:11:57 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:57 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db" returned: 0 in 0.290s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.253s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a9c6fe-8402-4262-99ff-3c35d79ab931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a5cc46-b444-4dd9-96dd-074b479dc1db', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762fc929-cce5-4169-a181-2fbe6667162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c47c089-01b9-4fdb-8d05-603047fa5917]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume volume-54a5cc46-b444-4dd9-96dd-074b479dc1db (54a5cc46-b444-4dd9-96dd-074b479dc1db): created successfully Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (762fc929-cce5-4169-a181-2fbe6667162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (0a085237-5998-4b41-a495-f51b02326957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7fbe5f8f-1a84-4beb-830c-c95e6bae4747 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created volume successfully. Sep 01 02:11:58 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:11:58 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:58 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.459s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[775704a2-34dd-49bd-9329-358b9c0ba6b3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:58 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:11:58 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-54b63469-b97b-4e01-9a8b-dfbdc9036312 req-db5ec686-758e-4a84-8cf8-56694f487d27 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:58 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.462s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:58 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img Sep 01 02:11:58 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (5bd3d802-56ba-4d0a-b726-93ccd98bb2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cd4271-8006-402f-80bd-a9e7d8cb8293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9cd4271-8006-402f-80bd-a9e7d8cb8293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238991554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177c2ecc-127d-4198-a032-608fdd5d6dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:59Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b37024e-a7bf-4b6d-9b21-379b47e4ebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b37024e-a7bf-4b6d-9b21-379b47e4ebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74b3953-c9e3-4698-9631-f7f7c05b4a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74b3953-c9e3-4698-9631-f7f7c05b4a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177c2ecc-127d-4198-a032-608fdd5d6dcd', 'volume_name': 'volume-177c2ecc-127d-4198-a032-608fdd5d6dcd', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3ad14e-51b1-4c8b-9c47-9c55d9cbd663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3ad14e-51b1-4c8b-9c47-9c55d9cbd663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689f5891-24e0-4ed8-aeb1-649dc0d7995f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume 177c2ecc-127d-4198-a032-608fdd5d6dcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177c2ecc-127d-4198-a032-608fdd5d6dcd', 'volume_size': 1} Sep 01 02:11:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (61a2b5f5-d411-44aa-847a-2cda501a9f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d38704-1aa6-4304-9c0c-c5d469894d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d38704-1aa6-4304-9c0c-c5d469894d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99941701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2ecc16-029f-4abf-a8d3-0b488fc315d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:00Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d0d19d-92a9-4c89-bb78-1ce77a4d988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d0d19d-92a9-4c89-bb78-1ce77a4d988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a8b1b4-a8b9-4c0a-a878-0821dcc371e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a8b1b4-a8b9-4c0a-a878-0821dcc371e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2ecc16-029f-4abf-a8d3-0b488fc315d9', 'volume_name': 'volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfca0e21-2074-480c-b974-14d9a8cd7355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfca0e21-2074-480c-b974-14d9a8cd7355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689a2e89-0cc5-4d2e-9b12-4dd13f7f402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:01 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume fd2ecc16-029f-4abf-a8d3-0b488fc315d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9', 'volume_size': 1} Sep 01 02:12:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (16f8bb9c-475e-45a3-aa68-45ee3e03caf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980ea6f3-6ab7-4f1a-9497-de76599733bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980ea6f3-6ab7-4f1a-9497-de76599733bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969482733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c9964b-de9d-4e0e-befd-52813c39a1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:02Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42a39bf-fbb6-4610-8757-2e1e098ecf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42a39bf-fbb6-4610-8757-2e1e098ecf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3708b00-6beb-4230-aae0-b3e1f8741207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3708b00-6beb-4230-aae0-b3e1f8741207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c9964b-de9d-4e0e-befd-52813c39a1e5', 'volume_name': 'volume-68c9964b-de9d-4e0e-befd-52813c39a1e5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c47d9a-b9c5-4263-bdae-bb16db89c43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55c47d9a-b9c5-4263-bdae-bb16db89c43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c1d6d0-7c57-4c01-8c99-2558ac8790b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:02 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume 68c9964b-de9d-4e0e-befd-52813c39a1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c9964b-de9d-4e0e-befd-52813c39a1e5', 'volume_size': 1} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (05de0c14-344d-47b3-b771-44b13266b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b563028a-1d95-4faf-bf81-5927f4f08cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b563028a-1d95-4faf-bf81-5927f4f08cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800663053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efeb66fd-46ef-485d-9a65-2b67a1dd711f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:03Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30757eb-c4f3-4afa-80eb-5313dcc09183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e30757eb-c4f3-4afa-80eb-5313dcc09183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da5d830-0827-4a90-ab17-39c5b75e8205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da5d830-0827-4a90-ab17-39c5b75e8205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efeb66fd-46ef-485d-9a65-2b67a1dd711f', 'volume_name': 'volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88430295-ad81-458e-9264-b3da659ae162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88430295-ad81-458e-9264-b3da659ae162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9680b9db-6bd2-45b7-a588-f708b7b74704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:03 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume efeb66fd-46ef-485d-9a65-2b67a1dd711f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f', 'volume_size': 1} Sep 01 02:12:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (5cb01965-e729-4479-9106-50aef76eb41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c038c9-99ff-4e31-a4b8-8801e526f8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16c038c9-99ff-4e31-a4b8-8801e526f8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891070207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff626eac-4697-4822-8d92-30b36a366c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:04Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef648f81-ba71-484c-9bbe-a8de37a51312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef648f81-ba71-484c-9bbe-a8de37a51312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd03b56-c2c2-4d28-8839-c35292a386e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd03b56-c2c2-4d28-8839-c35292a386e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff626eac-4697-4822-8d92-30b36a366c1e', 'volume_name': 'volume-ff626eac-4697-4822-8d92-30b36a366c1e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e1885f-14df-40d0-8524-d92e66395b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e1885f-14df-40d0-8524-d92e66395b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76571bf3-70fd-4c21-a8c6-9aba85bc58e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:04 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume ff626eac-4697-4822-8d92-30b36a366c1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff626eac-4697-4822-8d92-30b36a366c1e', 'volume_size': 1} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:04 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img" returned: 0 in 5.769s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[267834ad-a501-4f76-ad7f-839ffae2a7d1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:04 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:12:04 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:05 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.625s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:05 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:05 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Converted 1024.00 MB image at 177.48 MB/s Sep 01 02:12:05 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] 2087a066-5ead-4959-aa34-7028e63d0bec was raw, converting to qcow2 {{(pid=87425) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 02:12:05 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[211db2c5-525e-49a4-9541-19f8d53e6d05]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:05 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img Sep 01 02:12:05 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:05 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:05 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img Sep 01 02:12:05 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:06 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img" returned: 1 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img /opt/stack/data/cinder/conversion/vol_upload_f9hynqeb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:06 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img /opt/stack/data/cinder/conversion/vol_upload_f9hynqeb Sep 01 02:12:06 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:06 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:06 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:06 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img /opt/stack/data/cinder/conversion/vol_upload_f9hynqeb" returned: 0 in 0.290s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Image conversion details: src /opt/stack/data/cinder/conversion/b630ca8b-aa7c-4667-bd08-b31569caa72e.temp_image.2087a066-5ead-4959-aa34-7028e63d0becyn0v168a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_f9hynqeb {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:06 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[513e01b7-d9fe-4974-b4d8-b9636a5cf2fd]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f9hynqeb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:06 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f9hynqeb Sep 01 02:12:06 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:06 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.279s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:12:06 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_f9hynqeb" returned: 0 in 0.359s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.413s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Uploaded volume to glance image-id: 2087a066-5ead-4959-aa34-7028e63d0bec. {{(pid=87425) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-54b63469-b97b-4e01-9a8b-dfbdc9036312 req-db5ec686-758e-4a84-8cf8-56694f487d27 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.488s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-54b63469-b97b-4e01-9a8b-dfbdc9036312 req-db5ec686-758e-4a84-8cf8-56694f487d27 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.499s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238991554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177c2ecc-127d-4198-a032-608fdd5d6dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:59Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Creating volume 177c2ecc-127d-4198-a032-608fdd5d6dcd {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:08 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3a237919-d43a-44fb-88ad-a55d3bcf731b tempest-VolumesActionsTest-323385402 None] Copy volume to image completed successfully. Sep 01 02:12:08 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd 1073741824 Sep 01 02:12:08 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-54b63469-b97b-4e01-9a8b-dfbdc9036312 req-db5ec686-758e-4a84-8cf8-56694f487d27 tempest-AttachVolumeTestJSON-2025450295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7083a887-e312-4a9e-824c-fdd466da3cde', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:12:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-54b63469-b97b-4e01-9a8b-dfbdc9036312 req-db5ec686-758e-4a84-8cf8-56694f487d27 tempest-AttachVolumeTestJSON-2025450295 None] attachment_update completed successfully. Sep 01 02:12:08 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd 1073741824" returned: 0 in 0.577s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:09 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd Sep 01 02:12:09 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Acquiring lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Acquiring lock "cinder-quobyte-b630ca8b-aa7c-4667-bd08-b31569caa72e" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Lock "cinder-quobyte-b630ca8b-aa7c-4667-bd08-b31569caa72e" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:09 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd" returned: 0 in 0.393s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.038s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-99941701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2ecc16-029f-4abf-a8d3-0b488fc315d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:00Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Creating volume fd2ecc16-029f-4abf-a8d3-0b488fc315d9 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:09 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a54435-7a25-477c-ab38-148e80885084]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:09 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 1073741824 Sep 01 02:12:09 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689f5891-24e0-4ed8-aeb1-649dc0d7995f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177c2ecc-127d-4198-a032-608fdd5d6dcd', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02920fde-ca1c-4694-ada9-31f3586a194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume volume-177c2ecc-127d-4198-a032-608fdd5d6dcd (177c2ecc-127d-4198-a032-608fdd5d6dcd): created successfully Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02920fde-ca1c-4694-ada9-31f3586a194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (5bd3d802-56ba-4d0a-b726-93ccd98bb2b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-142fdb30-4f25-488a-a2fe-8de8a1770114 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created volume successfully. Sep 01 02:12:09 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:12:09 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:09 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.499s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:09 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e Sep 01 02:12:09 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:09 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 1073741824" returned: 0 in 0.569s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:10 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 Sep 01 02:12:10 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:10 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b630ca8b-aa7c-4667-bd08-b31569caa72e" returned: 0 in 0.298s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Lock "cinder-quobyte-b630ca8b-aa7c-4667-bd08-b31569caa72e" released by "delete_volume" :: held 0.873s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Created reservations ['7e9d4a30-b25d-4d49-bb65-d038b9133e44', 'a914517e-df27-4e60-851a-42d0ea319cda', 'a4c9ac60-c76e-417f-8442-c5e6a3d8a3f0', 'dd0b0d91-f4f5-4942-934a-28163f82e04f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:10 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9" returned: 0 in 0.361s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.933s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969482733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c9964b-de9d-4e0e-befd-52813c39a1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:02Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Creating volume 68c9964b-de9d-4e0e-befd-52813c39a1e5 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:10 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:10 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 1073741824 Sep 01 02:12:10 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689a2e89-0cc5-4d2e-9b12-4dd13f7f402c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc74d765-c01a-4937-bf8c-4123a503a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:10 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 (fd2ecc16-029f-4abf-a8d3-0b488fc315d9): created successfully Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc74d765-c01a-4937-bf8c-4123a503a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (61a2b5f5-d411-44aa-847a-2cda501a9f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ce67555c-5c50-4a9c-8fb0-feda4fcdec6a tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created volume successfully. Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:10 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:10 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:10 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.325s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Deleted volume successfully. Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b5bbf62a-cda7-401f-82fd-d8bc03d64126 tempest-VolumesActionsTest-323385402 None] Lock "cinder-b630ca8b-aa7c-4667-bd08-b31569caa72e-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:10 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 1073741824" returned: 0 in 0.566s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:11 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 Sep 01 02:12:11 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Flow 'volume_create_manager' (1f458b05-a1a7-4f31-9118-9c63e4d2dbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:11 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedcf717-e6ed-4631-8d73-98628425d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5" returned: 0 in 0.317s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.196s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800663053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efeb66fd-46ef-485d-9a65-2b67a1dd711f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:03Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Creating volume efeb66fd-46ef-485d-9a65-2b67a1dd711f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:11 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fedcf717-e6ed-4631-8d73-98628425d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-156080252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a52d59-1011-4c85-ae9c-f1ba37e40dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c3c4b8d5964e83ba77092dd0dda39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:11Z,use_quota=True,user_id='429053f9915141c8aba0382b733d1801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:11 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f 1073741824 Sep 01 02:12:11 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed97325e-3df8-4134-bdf1-9e896255da0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed97325e-3df8-4134-bdf1-9e896255da0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1543d1cf-9a3e-445b-bd9a-72c1832f098c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1543d1cf-9a3e-445b-bd9a-72c1832f098c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a52d59-1011-4c85-ae9c-f1ba37e40dc5', 'volume_name': 'volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858fea91-4b25-4f11-a0d8-2749543b6775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858fea91-4b25-4f11-a0d8-2749543b6775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61b7198-8f62-418c-b69f-6c7bbb513f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:11 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Volume 21a52d59-1011-4c85-ae9c-f1ba37e40dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5', 'volume_size': 1} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c1d6d0-7c57-4c01-8c99-2558ac8790b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c9964b-de9d-4e0e-befd-52813c39a1e5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2948fe25-4025-452b-9305-1bcd79b3e820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:11 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 (68c9964b-de9d-4e0e-befd-52813c39a1e5): created successfully Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2948fe25-4025-452b-9305-1bcd79b3e820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (16f8bb9c-475e-45a3-aa68-45ee3e03caf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-946fcbb2-d548-4dd4-b593-0c1f4ef9e993 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created volume successfully. Sep 01 02:12:11 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f 1073741824" returned: 0 in 0.549s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:11 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f Sep 01 02:12:11 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:12 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f" returned: 0 in 0.314s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.047s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-891070207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff626eac-4697-4822-8d92-30b36a366c1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254aaaa8870a47a4a8edfc87fbafd79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:04Z,use_quota=True,user_id='9e85eea0e7aa4b8abd3491178f8cb34d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Creating volume ff626eac-4697-4822-8d92-30b36a366c1e {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:12 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9680b9db-6bd2-45b7-a588-f708b7b74704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:12 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e 1073741824 Sep 01 02:12:12 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07eca31f-228e-43a7-a7bb-871b6bd9a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:12 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f (efeb66fd-46ef-485d-9a65-2b67a1dd711f): created successfully Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07eca31f-228e-43a7-a7bb-871b6bd9a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (05de0c14-344d-47b3-b771-44b13266b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:12 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7c16c578-5ba2-453a-9830-7b4208ebdbb3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created volume successfully. Sep 01 02:12:12 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e 1073741824" returned: 0 in 0.510s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:12 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e Sep 01 02:12:12 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:13 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e" returned: 0 in 0.292s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.708s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-156080252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a52d59-1011-4c85-ae9c-f1ba37e40dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20c3c4b8d5964e83ba77092dd0dda39a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:11Z,use_quota=True,user_id='429053f9915141c8aba0382b733d1801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Creating volume 21a52d59-1011-4c85-ae9c-f1ba37e40dc5 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:13 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76571bf3-70fd-4c21-a8c6-9aba85bc58e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff626eac-4697-4822-8d92-30b36a366c1e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 1073741824 Sep 01 02:12:13 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62e19d3-b402-42d4-b931-65cea36dda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Volume volume-ff626eac-4697-4822-8d92-30b36a366c1e (ff626eac-4697-4822-8d92-30b36a366c1e): created successfully Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62e19d3-b402-42d4-b931-65cea36dda24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Flow 'volume_create_manager' (5cb01965-e729-4479-9106-50aef76eb41c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-605ab4bb-87b3-43c7-8538-48ace013b4da tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created volume successfully. Sep 01 02:12:13 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 1073741824" returned: 0 in 0.563s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:13 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 Sep 01 02:12:13 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:14 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5" returned: 0 in 0.311s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61b7198-8f62-418c-b69f-6c7bbb513f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb0d761-544a-41cf-bce4-373a251325cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-ff626eac-4697-4822-8d92-30b36a366c1e-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:14 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Volume volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 (21a52d59-1011-4c85-ae9c-f1ba37e40dc5): created successfully Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cb0d761-544a-41cf-bce4-373a251325cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Flow 'volume_create_manager' (1f458b05-a1a7-4f31-9118-9c63e4d2dbc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-ff626eac-4697-4822-8d92-30b36a366c1e-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-64a5e898-4df8-42d7-8f78-47171b0cb0fd tempest-AttachVolumeTestJSON-2025450295 None] Created volume successfully. Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-quobyte-ff626eac-4697-4822-8d92-30b36a366c1e" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-ff626eac-4697-4822-8d92-30b36a366c1e" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3b7b6d-54c9-417d-adb4-18eed83b7ad5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:14 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e Sep 01 02:12:14 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:14 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e" returned: 0 in 0.495s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:14 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e Sep 01 02:12:14 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ff626eac-4697-4822-8d92-30b36a366c1e" returned: 0 in 0.326s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-ff626eac-4697-4822-8d92-30b36a366c1e" released by "delete_volume" :: held 0.878s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created reservations ['0d292fbb-af66-4d06-98df-7781eda50363', 'd552aac5-cf96-4425-a3b3-287b766fbbc2', 'd46e0846-5e3e-4387-bf6f-09eb97db6e95', 'bd6449c1-eca7-40ce-8ccd-4db4a7eae55f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:15 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:15 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-efeb66fd-46ef-485d-9a65-2b67a1dd711f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-efeb66fd-46ef-485d-9a65-2b67a1dd711f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-quobyte-efeb66fd-46ef-485d-9a65-2b67a1dd711f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-115e7e03-11f5-401f-953b-cb73b4c38d75 req-58fef735-b447-4cc4-93ba-6ca02c0edc23 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-115e7e03-11f5-401f-953b-cb73b4c38d75 req-58fef735-b447-4cc4-93ba-6ca02c0edc23 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-efeb66fd-46ef-485d-9a65-2b67a1dd711f" acquired by "delete_volume" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-115e7e03-11f5-401f-953b-cb73b4c38d75 req-58fef735-b447-4cc4-93ba-6ca02c0edc23 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa96fc-574d-4f27-9313-8ab3163e4d35]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-115e7e03-11f5-401f-953b-cb73b4c38d75 req-58fef735-b447-4cc4-93ba-6ca02c0edc23 tempest-AttachVolumeTestJSON-2025450295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b39d70c3-dbc3-4468-978b-2194432f03db', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:12:15 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.344s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Deleted volume successfully. Sep 01 02:12:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-115e7e03-11f5-401f-953b-cb73b4c38d75 req-58fef735-b447-4cc4-93ba-6ca02c0edc23 tempest-AttachVolumeTestJSON-2025450295 None] attachment_update completed successfully. Sep 01 02:12:15 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f Sep 01 02:12:15 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8e94c37-fe01-451b-8e8e-577b3d87da17 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-ff626eac-4697-4822-8d92-30b36a366c1e-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:16 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f" returned: 0 in 0.550s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f Sep 01 02:12:16 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-efeb66fd-46ef-485d-9a65-2b67a1dd711f" returned: 0 in 0.390s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-efeb66fd-46ef-485d-9a65-2b67a1dd711f" released by "delete_volume" :: held 1.012s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created reservations ['172ddffc-f820-437e-8394-d25937e13b0a', '8ef04afb-8aa1-4198-823e-8388ab913f4f', 'd4ba2170-b7e2-47dd-977e-b3bc15146ef3', '53361c1c-9e14-47b2-9b61-80ef4bbade26'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:16 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.297s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Deleted volume successfully. Sep 01 02:12:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0617658d-1649-4093-ac09-5abd5d872a1d tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-efeb66fd-46ef-485d-9a65-2b67a1dd711f-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-68c9964b-de9d-4e0e-befd-52813c39a1e5-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-68c9964b-de9d-4e0e-befd-52813c39a1e5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-quobyte-68c9964b-de9d-4e0e-befd-52813c39a1e5" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-68c9964b-de9d-4e0e-befd-52813c39a1e5" acquired by "delete_volume" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:17 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8c30f-940a-46b6-b1b3-9f4f1d6f96eb]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 Sep 01 02:12:17 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5" returned: 0 in 0.479s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:18 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5 Sep 01 02:12:18 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-5b706646-2171-4668-b65d-c959ed16d4ae req-74e73862-03eb-4fd4-a2ef-dd6fd745f306 tempest-AttachVolumeTestJSON-2025450295 None] Terminate volume connection completed successfully. Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-5b706646-2171-4668-b65d-c959ed16d4ae req-74e73862-03eb-4fd4-a2ef-dd6fd745f306 tempest-AttachVolumeTestJSON-2025450295 None] Deleting attachment 7083a887-e312-4a9e-824c-fdd466da3cde. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:12:18 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-68c9964b-de9d-4e0e-befd-52813c39a1e5" returned: 0 in 0.309s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-68c9964b-de9d-4e0e-befd-52813c39a1e5" released by "delete_volume" :: held 0.855s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created reservations ['31ee9853-2877-4a24-9702-0e02fbedeb60', 'a81615c9-5376-4b21-9a18-0a8048b62bd2', 'b71fb686-6a63-4c0d-a93f-408e3187ef7a', '19667abf-f9b3-47be-807d-cf8870abb926'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:18 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:18 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-fd2ecc16-029f-4abf-a8d3-0b488fc315d9-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-fd2ecc16-029f-4abf-a8d3-0b488fc315d9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-quobyte-fd2ecc16-029f-4abf-a8d3-0b488fc315d9" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-fd2ecc16-029f-4abf-a8d3-0b488fc315d9" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[da280543-2d8c-4f11-935a-3289a6436c37]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:19 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.321s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Deleted volume successfully. Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2d7d1d29-782a-42b0-8564-7740ae1087f3 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-68c9964b-de9d-4e0e-befd-52813c39a1e5-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:19 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 Sep 01 02:12:19 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:19 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9" returned: 0 in 0.521s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:19 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9 Sep 01 02:12:19 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:19 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd2ecc16-029f-4abf-a8d3-0b488fc315d9" returned: 0 in 0.324s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-fd2ecc16-029f-4abf-a8d3-0b488fc315d9" released by "delete_volume" :: held 0.901s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=68,cinder:SELECT=64,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:19 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created reservations ['dfb6b19e-7aff-45e6-ba68-42ebc7ca1b67', '5f9ff138-56b0-4fe6-807a-1b508bcbb082', '9691e35b-fc58-4908-b2e4-3a3ed0dfef9d', 'a7aca01d-9bab-429d-ae9b-5edd2f6f6722'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-b4e9127d-3ab4-4807-9867-41ca7c0ee560 req-99df29ec-1e4b-4685-ac89-fc95f8c2ea8f tempest-AttachVolumeTestJSON-2025450295 None] Terminate volume connection completed successfully. Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-b4e9127d-3ab4-4807-9867-41ca7c0ee560 req-99df29ec-1e4b-4685-ac89-fc95f8c2ea8f tempest-AttachVolumeTestJSON-2025450295 None] Deleting attachment b39d70c3-dbc3-4468-978b-2194432f03db. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:20 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:20 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-177c2ecc-127d-4198-a032-608fdd5d6dcd-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-177c2ecc-127d-4198-a032-608fdd5d6dcd-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:20 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.345s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Deleted volume successfully. Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-quobyte-177c2ecc-127d-4198-a032-608fdd5d6dcd" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f6a2c748-efa9-4e02-bc22-a254325d6dd7 tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-fd2ecc16-029f-4abf-a8d3-0b488fc315d9-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-177c2ecc-127d-4198-a032-608fdd5d6dcd" acquired by "delete_volume" :: waited 0.037s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Flow 'volume_create_manager' (00e331d0-724e-4fa9-93ac-c7325c6545a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d67088-8124-4572-ab02-f477f685d599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf69ca90-46dd-4177-ab58-7cfcb5f735b9]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d67088-8124-4572-ab02-f477f685d599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-738827344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d25a15-bee5-4152-83fe-e480401bf0c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a6d92476f1466f8927ea56ecde7f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:20Z,use_quota=True,user_id='bf8ea9d224d84413b8bb60b89155738f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a54e42c-a726-4d07-8663-513f48d54f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a54e42c-a726-4d07-8663-513f48d54f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1dbcff-fe94-4dad-ae07-855577567ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e1dbcff-fe94-4dad-ae07-855577567ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d25a15-bee5-4152-83fe-e480401bf0c1', 'volume_name': 'volume-f7d25a15-bee5-4152-83fe-e480401bf0c1', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb09592e-2e9a-4396-98d5-973ce79a6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb09592e-2e9a-4396-98d5-973ce79a6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99723aa-1eb2-4d3d-85f7-7b478de20a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:20 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Volume f7d25a15-bee5-4152-83fe-e480401bf0c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d25a15-bee5-4152-83fe-e480401bf0c1', 'volume_size': 1} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-738827344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d25a15-bee5-4152-83fe-e480401bf0c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a6d92476f1466f8927ea56ecde7f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:20Z,use_quota=True,user_id='bf8ea9d224d84413b8bb60b89155738f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Creating volume f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:20 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:20 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 1073741824 Sep 01 02:12:20 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:20 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd Sep 01 02:12:20 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd" returned: 0 in 0.451s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:21 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd Sep 01 02:12:21 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 1073741824" returned: 0 in 0.581s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:21 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 Sep 01 02:12:21 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-177c2ecc-127d-4198-a032-608fdd5d6dcd" returned: 0 in 0.320s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-177c2ecc-127d-4198-a032-608fdd5d6dcd" released by "delete_volume" :: held 0.846s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created reservations ['3056904c-c293-49bf-b89c-01fc2e1d0d10', '33ed61d1-807f-42d5-a043-3099a709d3e8', '051994d4-f0bb-4582-9301-12521dd34b17', '6ce6e579-ea96-4ac3-b3d6-2c54e92b17f8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:21 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:21 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1" returned: 0 in 0.444s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99723aa-1eb2-4d3d-85f7-7b478de20a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d25a15-bee5-4152-83fe-e480401bf0c1', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a02219-b322-432a-b259-caab958b5fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:21 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Volume volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 (f7d25a15-bee5-4152-83fe-e480401bf0c1): created successfully Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a02219-b322-432a-b259-caab958b5fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Flow 'volume_create_manager' (00e331d0-724e-4fa9-93ac-c7325c6545a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:21 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=70,cinder:INSERT=22,cinder:UPDATE=92,cinder:DELETE=7 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-80e20307-f19a-4924-a606-8c8e813656ab tempest-VolumesCloneTest-1196349078 None] Created volume successfully. Sep 01 02:12:22 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.477s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Deleted volume successfully. Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6068129a-eabf-47b5-9478-11341204309e tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-177c2ecc-127d-4198-a032-608fdd5d6dcd-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-54a5cc46-b444-4dd9-96dd-074b479dc1db-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-54a5cc46-b444-4dd9-96dd-074b479dc1db-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "cinder-quobyte-54a5cc46-b444-4dd9-96dd-074b479dc1db" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-54a5cc46-b444-4dd9-96dd-074b479dc1db" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f357f93-ff24-4a78-b085-f086b46602d6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:23 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db Sep 01 02:12:23 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:23 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db" returned: 0 in 0.622s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:23 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db Sep 01 02:12:23 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Flow 'volume_create_manager' (376bd5f0-b01c-4bd2-b032-33b1bfbf5fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8253a2-1e3b-4098-9fe0-4cd039f149f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8253a2-1e3b-4098-9fe0-4cd039f149f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-103434553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28933d80-69a9-4bb0-83bb-07ec6c33876d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a6d92476f1466f8927ea56ecde7f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f7d25a15-bee5-4152-83fe-e480401bf0c1,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:23Z,use_quota=True,user_id='bf8ea9d224d84413b8bb60b89155738f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53787a6e-b570-4cad-852d-c0479e1fefe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53787a6e-b570-4cad-852d-c0479e1fefe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c56fdd-7d48-4ed6-945f-1e457f963446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c56fdd-7d48-4ed6-945f-1e457f963446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '28933d80-69a9-4bb0-83bb-07ec6c33876d', 'volume_name': 'volume-28933d80-69a9-4bb0-83bb-07ec6c33876d', 'volume_size': 2, 'source_volid': 'f7d25a15-bee5-4152-83fe-e480401bf0c1', 'source_volstatus': 'available'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88932179-89e2-4495-a278-89105e61f053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88932179-89e2-4495-a278-89105e61f053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d47fbe-02e6-433c-868b-4ced3cb61a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Volume 28933d80-69a9-4bb0-83bb-07ec6c33876d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-28933d80-69a9-4bb0-83bb-07ec6c33876d', 'volume_size': 2, 'source_volid': 'f7d25a15-bee5-4152-83fe-e480401bf0c1', 'source_volstatus': 'available'} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:23 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Cloning volume f7d25a15-bee5-4152-83fe-e480401bf0c1 to volume 28933d80-69a9-4bb0-83bb-07ec6c33876d Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Creating offline snapshot 2d5d1e5b-d148-408c-a1fa-aded272f30e1 of volume f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf7f395-9034-44da-a82e-ff4376423be9]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:23 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-54a5cc46-b444-4dd9-96dd-074b479dc1db" returned: 0 in 0.349s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-quobyte-54a5cc46-b444-4dd9-96dd-074b479dc1db" released by "delete_volume" :: held 1.026s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:23 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 Sep 01 02:12:23 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:23 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Created reservations ['5b5c2adb-bbbc-40c5-ac77-437231e2eef9', 'bf5a5883-5832-49cd-b58c-520da9c571a9', 'db414993-133c-42c3-b818-d21b4bfda58a', '4cc79ec2-84c0-4916-9c0f-d3b4976491ec'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:24 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:24 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:24 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1" returned: 0 in 0.479s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:24 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 1G Sep 01 02:12:24 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:24 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.300s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Deleted volume successfully. Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c69a462c-b0c8-4898-a7dc-7dd1c64c4e8f tempest-CreateVolumesFromSourceVolumeTest-1908592985 None] Lock "cinder-54a5cc46-b444-4dd9-96dd-074b479dc1db-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:24 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 1G" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:24 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 Sep 01 02:12:24 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:25 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1" returned: 0 in 0.359s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:25 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 is being set with open permissions: ugo+rw Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:25 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 Sep 01 02:12:25 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:25 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1" returned: 0 in 0.369s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:25 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.info Sep 01 02:12:25 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "cinder-21a52d59-1011-4c85-ae9c-f1ba37e40dc5-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-21a52d59-1011-4c85-ae9c-f1ba37e40dc5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "cinder-quobyte-21a52d59-1011-4c85-ae9c-f1ba37e40dc5" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-quobyte-21a52d59-1011-4c85-ae9c-f1ba37e40dc5" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:25 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5727298-ca72-4250-8d4e-f5e3e6becabd]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.info" returned: 0 in 0.335s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:25 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.info is being set with open permissions: ugo+rw Sep 01 02:12:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:25 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.info Sep 01 02:12:25 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:25 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 Sep 01 02:12:25 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.info" returned: 0 in 0.328s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Acquiring lock "cinder-quobyte-28933d80-69a9-4bb0-83bb-07ec6c33876d" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Lock "cinder-quobyte-28933d80-69a9-4bb0-83bb-07ec6c33876d" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] snapshot: 2d5d1e5b-d148-408c-a1fa-aded272f30e1, volume: 28933d80-69a9-4bb0-83bb-07ec6c33876d, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[065c951c-709e-4c82-8c70-54040ce1cb6f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5" returned: 0 in 0.491s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5 Sep 01 02:12:26 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 Sep 01 02:12:26 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-21a52d59-1011-4c85-ae9c-f1ba37e40dc5" returned: 0 in 0.302s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-quobyte-21a52d59-1011-4c85-ae9c-f1ba37e40dc5" released by "delete_volume" :: held 0.844s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:26 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1" returned: 0 in 0.452s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7d25a15-bee5-4152-83fe-e480401bf0c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Created reservations ['720f6dc7-c076-462a-bf62-cd60ed92c543', '81f46e8e-d8d7-4f5d-ae0c-ce45c2c207e1', 'bb2b907d-8aab-4613-9e73-07de78661a3b', '8f39000a-fe48-4905-93d6-635b4c17e3b7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c721235-d816-494c-82ed-05aae72d7187]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:26 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 Sep 01 02:12:26 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:26 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "cinder-036f1ecc-f8d7-4214-aaea-3b9e39d5a205-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-036f1ecc-f8d7-4214-aaea-3b9e39d5a205-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "cinder-quobyte-036f1ecc-f8d7-4214-aaea-3b9e39d5a205" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-quobyte-036f1ecc-f8d7-4214-aaea-3b9e39d5a205" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e703a55-be0d-44c6-b500-94ba933aac9d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:27 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:27 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.349s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:27 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Deleted volume successfully. Sep 01 02:12:27 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1" returned: 0 in 0.513s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a04a525b-c862-43cb-bb56-52d0ee59fee1 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-21a52d59-1011-4c85-ae9c-f1ba37e40dc5-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:27 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d Sep 01 02:12:27 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:27 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205" returned: 0 in 0.470s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:27 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205 Sep 01 02:12:27 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:27 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-036f1ecc-f8d7-4214-aaea-3b9e39d5a205" returned: 0 in 0.329s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-quobyte-036f1ecc-f8d7-4214-aaea-3b9e39d5a205" released by "delete_volume" :: held 0.875s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Created reservations ['f22f8850-b8b8-4eb2-9926-ac673f6c8299', '69b45680-1253-44d7-b8c7-40c08d29d96c', '0addd87e-0bf3-4a36-9f01-32b519fbbaf3', '0f84eedf-e115-4274-8bcc-2921176cbcae'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:28 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:28 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "cinder-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "cinder-quobyte-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:29 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.832s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:29 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Deleted volume successfully. Sep 01 02:12:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-quobyte-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7" acquired by "delete_volume" :: waited 0.047s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bdcca85a-3d80-419c-9146-13d8f56f3741 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-036f1ecc-f8d7-4214-aaea-3b9e39d5a205-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:29 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[68642cd7-31d2-401b-bc92-8e252983558f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:29 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 Sep 01 02:12:29 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:30 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7" returned: 0 in 1.102s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:30 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7 Sep 01 02:12:30 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7" returned: 0 in 0.778s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-quobyte-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7" released by "delete_volume" :: held 2.019s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Created reservations ['eab711c4-d9b6-4c8e-8d6b-dfccd3ba9516', 'e549aef2-4b26-4700-8382-e1c93245faf1', 'cebdf14c-4e65-488e-abe1-093a0ac58159', 'b87ae3a7-befc-42f6-a5b5-cb95a4377772'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:31 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:32 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.665s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:32 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Deleted volume successfully. Sep 01 02:12:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-47e095e1-71f6-4ee4-8de8-442ea017b285 tempest-AttachVolumeTestJSON-2025450295 None] Lock "cinder-ba8ecf6d-068b-44c0-bf8a-532ab010b3a7-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:33 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d" returned: 0 in 6.235s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:33 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Converted 1024.00 MB image at 164.22 MB/s Sep 01 02:12:33 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d is being set with open permissions: ugo+rw Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:33 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d Sep 01 02:12:33 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:33 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d" returned: 0 in 0.325s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Lock "cinder-quobyte-28933d80-69a9-4bb0-83bb-07ec6c33876d" released by "_copy_volume_from_snapshot" :: held 7.606s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Acquiring lock "cinder-quobyte-2d5d1e5b-d148-408c-a1fa-aded272f30e1" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Lock "cinder-quobyte-2d5d1e5b-d148-408c-a1fa-aded272f30e1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Deleting offline snapshot 2d5d1e5b-d148-408c-a1fa-aded272f30e1 of volume f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] snapshot_file for this snap is: volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cad458-9202-4572-b5c6-154440d429f7]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 Sep 01 02:12:34 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:34 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1" returned: 0 in 0.479s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7d25a15-bee5-4152-83fe-e480401bf0c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce8a9b4-622c-41f4-ac97-f294aa80d529]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 Sep 01 02:12:34 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1" returned: 0 in 0.698s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 Sep 01 02:12:35 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1" returned: 0 in 0.539s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1 Sep 01 02:12:35 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Flow 'volume_create_manager' (4aee3939-df4d-4e93-989c-ce0bb6120ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15569e77-e353-4f36-b4c0-f1816382e8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15569e77-e353-4f36-b4c0-f1816382e8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed218fd-010c-4061-b06b-7297a0923137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba7840d59614e37823b3444f91c0c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:36Z,use_quota=True,user_id='279190f4d0c74556825c33bb2353255e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72b32f3-329d-43a7-ae45-a7d2f113985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72b32f3-329d-43a7-ae45-a7d2f113985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3581165e-d31d-4147-a9ff-8fc2dd5ca197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:12:36 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1.2d5d1e5b-d148-408c-a1fa-aded272f30e1" returned: 0 in 0.339s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Lock "cinder-quobyte-2d5d1e5b-d148-408c-a1fa-aded272f30e1" released by "_delete_snapshot" :: held 2.199s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.431s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d47fbe-02e6-433c-868b-4ced3cb61a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28933d80-69a9-4bb0-83bb-07ec6c33876d', 'volume_size': 2, 'source_volid': 'f7d25a15-bee5-4152-83fe-e480401bf0c1', 'source_volstatus': 'available'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2c2b5e-bf54-4d60-b74a-6d6394790179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:36 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Volume volume-28933d80-69a9-4bb0-83bb-07ec6c33876d (28933d80-69a9-4bb0-83bb-07ec6c33876d): created successfully Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2c2b5e-bf54-4d60-b74a-6d6394790179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Flow 'volume_create_manager' (376bd5f0-b01c-4bd2-b032-33b1bfbf5fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cbe2b780-4f95-4e05-af1a-c1e1ffccadf3 tempest-VolumesCloneTest-1196349078 None] Created volume successfully. Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3581165e-d31d-4147-a9ff-8fc2dd5ca197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ed218fd-010c-4061-b06b-7297a0923137', 'volume_name': 'volume-7ed218fd-010c-4061-b06b-7297a0923137', 'volume_size': 1, 'image_id': 'd98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3eb5b992811faae28ca9bdb9cfef1126', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aba7840d59614e37823b3444f91c0c3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fec6d9ed01c9c534942dae08dfb6722571d1fadebfed4b27bd0f0a6b8a28af570e2c50f7dbf71d0b91fca94bc212a7e33ed990f3a8ee93df1844833f3973c9a', 'id': 'd98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb/file', 'properties': {}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8e4b31-bccd-4e31-a421-6f2d1e7a95c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8e4b31-bccd-4e31-a421-6f2d1e7a95c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b21ed4f-58aa-4be0-b9bf-0296a23f2c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:36 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Volume 7ed218fd-010c-4061-b06b-7297a0923137: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ed218fd-010c-4061-b06b-7297a0923137', 'volume_size': 1, 'image_id': 'd98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3eb5b992811faae28ca9bdb9cfef1126', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aba7840d59614e37823b3444f91c0c3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fec6d9ed01c9c534942dae08dfb6722571d1fadebfed4b27bd0f0a6b8a28af570e2c50f7dbf71d0b91fca94bc212a7e33ed990f3a8ee93df1844833f3973c9a', 'id': 'd98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb/file', 'properties': {}}, 'image_service': } Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Trying to clone 7ed218fd-010c-4061-b06b-7297a0923137 from image d98713dd-45c2-4ec9-85aa-652a7f19d4cb at location (None, [{'url': 'file:///opt/stack/data/glance/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:12:36 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f3da72-2e17-462c-a7b3-556f9d0f83e3]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD Sep 01 02:12:36 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Acquiring lock "cinder-28933d80-69a9-4bb0-83bb-07ec6c33876d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Lock "cinder-28933d80-69a9-4bb0-83bb-07ec6c33876d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Acquiring lock "cinder-quobyte-28933d80-69a9-4bb0-83bb-07ec6c33876d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Lock "cinder-quobyte-28933d80-69a9-4bb0-83bb-07ec6c33876d" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:37 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD Sep 01 02:12:37 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e381d0-497f-4ee2-bdaf-7222d0fc4d44]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d Sep 01 02:12:37 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Temporary image d98713dd-45c2-4ec9-85aa-652a7f19d4cb is fetched for user 279190f4d0c74556825c33bb2353255e. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eabc3d-3ee5-466c-b45d-b2a131b73e4b]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d" returned: 0 in 0.444s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD Sep 01 02:12:37 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d Sep 01 02:12:37 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-28933d80-69a9-4bb0-83bb-07ec6c33876d" returned: 0 in 0.389s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Lock "cinder-quobyte-28933d80-69a9-4bb0-83bb-07ec6c33876d" released by "delete_volume" :: held 0.901s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:38 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD Sep 01 02:12:38 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Created reservations ['8cd600a0-0c7c-4cd0-97eb-0b3f337b2203', '4e2a52ea-caa4-48a6-a321-928762163d62', 'dde5a251-3e0b-4c9c-bde8-6c1b12aeb2f3', '078d662e-8577-4c97-9116-cba49b80f87d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:38 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Acquiring lock "cinder-f7d25a15-bee5-4152-83fe-e480401bf0c1-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:38 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD" returned: 1 in 0.503s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed218fd-010c-4061-b06b-7297a0923137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba7840d59614e37823b3444f91c0c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:36Z,use_quota=True,user_id='279190f4d0c74556825c33bb2353255e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Creating volume 7ed218fd-010c-4061-b06b-7297a0923137 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:38 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Lock "cinder-f7d25a15-bee5-4152-83fe-e480401bf0c1-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:38 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 1073741824 Sep 01 02:12:38 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Acquiring lock "cinder-quobyte-f7d25a15-bee5-4152-83fe-e480401bf0c1" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Lock "cinder-quobyte-f7d25a15-bee5-4152-83fe-e480401bf0c1" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36d0b0a-b5bd-4cfd-8805-3ac47a17b6fe]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.393s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:38 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Deleted volume successfully. Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ad4d754-a4fb-4633-8a68-bbaad9edc4f9 tempest-VolumesCloneTest-1196349078 None] Lock "cinder-28933d80-69a9-4bb0-83bb-07ec6c33876d-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:38 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 Sep 01 02:12:38 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 1073741824" returned: 0 in 0.613s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1" returned: 0 in 0.470s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1 Sep 01 02:12:39 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 Sep 01 02:12:39 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7d25a15-bee5-4152-83fe-e480401bf0c1" returned: 0 in 0.356s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Lock "cinder-quobyte-f7d25a15-bee5-4152-83fe-e480401bf0c1" released by "delete_volume" :: held 0.904s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Created reservations ['803776e6-7cfd-4ea3-93dc-c4bc482f2351', '5092a6f7-346c-4745-a853-3b024462c8f2', '0599fc7e-6e46-4563-ac4c-fc24c4c2ebc4', '731a1033-662d-41dd-b783-c0628d13dbcb'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:39 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137" returned: 0 in 0.450s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Attempting download of d98713dd-45c2-4ec9-85aa-652a7f19d4cb ((None, [{'url': 'file:///opt/stack/data/glance/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'metadata': {}}])) to volume 7ed218fd-010c-4061-b06b-7297a0923137. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:39 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd814a59-745f-42b4-87a3-7f29680dc43c]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_3nri9yn_ {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_3nri9yn_ Sep 01 02:12:39 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.296s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Deleted volume successfully. Sep 01 02:12:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d4ab9ad7-92a2-494e-acf5-b4ede40579ca tempest-VolumesCloneTest-1196349078 None] Lock "cinder-f7d25a15-bee5-4152-83fe-e480401bf0c1-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:40 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_3nri9yn_" returned: 0 in 0.393s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_3nri9yn_ {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_3nri9yn_ Sep 01 02:12:40 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_3nri9yn_" returned: 1 in 0.414s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_3nri9yn_' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:40 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d88358-8142-4844-af51-577e7228965b]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD Sep 01 02:12:40 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:41 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD Sep 01 02:12:41 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:41 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD" returned: 1 in 0.446s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:41 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] d98713dd-45c2-4ec9-85aa-652a7f19d4cb was raw, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:12:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:41 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 Sep 01 02:12:41 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:41 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137" returned: 0 in 0.657s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d98713dd-45c2-4ec9-85aa-652a7f19d4cb_y2fgqarkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:12:41 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:42 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 1G Sep 01 02:12:42 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:42 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 1G" returned: 0 in 0.532s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Downloaded image d98713dd-45c2-4ec9-85aa-652a7f19d4cb ((None, [{'url': 'file:///opt/stack/data/glance/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'metadata': {}}])) to volume 7ed218fd-010c-4061-b06b-7297a0923137 successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Temporary image d98713dd-45c2-4ec9-85aa-652a7f19d4cb for user 279190f4d0c74556825c33bb2353255e is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Marking volume 7ed218fd-010c-4061-b06b-7297a0923137 as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Copying metadata from image d98713dd-45c2-4ec9-85aa-652a7f19d4cb to 7ed218fd-010c-4061-b06b-7297a0923137. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Creating volume glance metadata for volume 7ed218fd-010c-4061-b06b-7297a0923137 backed by image d98713dd-45c2-4ec9-85aa-652a7f19d4cb with: {'image_id': 'd98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3eb5b992811faae28ca9bdb9cfef1126', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b21ed4f-58aa-4be0-b9bf-0296a23f2c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed218fd-010c-4061-b06b-7297a0923137', 'volume_size': 1, 'image_id': 'd98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3eb5b992811faae28ca9bdb9cfef1126', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aba7840d59614e37823b3444f91c0c3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1fec6d9ed01c9c534942dae08dfb6722571d1fadebfed4b27bd0f0a6b8a28af570e2c50f7dbf71d0b91fca94bc212a7e33ed990f3a8ee93df1844833f3973c9a', 'id': 'd98713dd-45c2-4ec9-85aa-652a7f19d4cb', 'created_at': datetime.datetime(2026, 9, 1, 0, 12, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 12, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d98713dd-45c2-4ec9-85aa-652a7f19d4cb/file', 'properties': {}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370573de-38ae-4558-b0f1-3fedfc59ba20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:42 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Volume volume-7ed218fd-010c-4061-b06b-7297a0923137 (7ed218fd-010c-4061-b06b-7297a0923137): created successfully Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370573de-38ae-4558-b0f1-3fedfc59ba20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Flow 'volume_create_manager' (4aee3939-df4d-4e93-989c-ce0bb6120ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cafa2b52-024f-40c1-a128-08aa01f8da77 tempest-VolumeImageDependencyTests-1038694254 None] Created volume successfully. Sep 01 02:12:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Acquiring lock "cinder-7ed218fd-010c-4061-b06b-7297a0923137-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Lock "cinder-7ed218fd-010c-4061-b06b-7297a0923137-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Acquiring lock "cinder-quobyte-7ed218fd-010c-4061-b06b-7297a0923137" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Lock "cinder-quobyte-7ed218fd-010c-4061-b06b-7297a0923137" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e989e46b-48ab-4621-a127-0a775c453960]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:44 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 Sep 01 02:12:44 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:44 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137" returned: 0 in 0.504s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:44 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137 Sep 01 02:12:44 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:44 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7ed218fd-010c-4061-b06b-7297a0923137" returned: 0 in 0.317s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Lock "cinder-quobyte-7ed218fd-010c-4061-b06b-7297a0923137" released by "delete_volume" :: held 0.889s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Created reservations ['2f5f08c0-f2ab-418f-8e9f-c4d8122ae978', '3b649646-edf0-4129-9f31-ac5f9643da21', '551fc6d3-628f-41a8-9c33-83ae76ddb2ed', '0890fb51-4337-4149-9109-a550b38dc623'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:44 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:44 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:45 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.363s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:45 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Deleted volume successfully. Sep 01 02:12:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7873d9d-5055-49cd-8a7b-ccab2b5e1772 tempest-VolumeImageDependencyTests-1038694254 None] Lock "cinder-7ed218fd-010c-4061-b06b-7297a0923137-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Flow 'volume_create_manager' (b6df4324-3fe8-4090-8d0f-d32336ec8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c2d766-3c42-4bc7-8b47-41572a7c76be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c2d766-3c42-4bc7-8b47-41572a7c76be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161492985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22da03f-24bb-41bc-a305-8820a13cab8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f2e18cb87c45b29b6c8a1440b5e14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:52Z,use_quota=True,user_id='8b629d5562b046df948e66aae4d6802d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6cf1cf-826a-4990-bea4-d13ba09aafeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6cf1cf-826a-4990-bea4-d13ba09aafeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90925bf-d1e4-4e42-9883-ee50680bd7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90925bf-d1e4-4e42-9883-ee50680bd7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22da03f-24bb-41bc-a305-8820a13cab8c', 'volume_name': 'volume-f22da03f-24bb-41bc-a305-8820a13cab8c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21844a72-ce0b-4ab5-ab44-942892f6df2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21844a72-ce0b-4ab5-ab44-942892f6df2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74252364-d370-4de4-b210-5d5764529748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:51 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Volume f22da03f-24bb-41bc-a305-8820a13cab8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22da03f-24bb-41bc-a305-8820a13cab8c', 'volume_size': 1} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161492985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22da03f-24bb-41bc-a305-8820a13cab8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f2e18cb87c45b29b6c8a1440b5e14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:52Z,use_quota=True,user_id='8b629d5562b046df948e66aae4d6802d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Creating volume f22da03f-24bb-41bc-a305-8820a13cab8c {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:51 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c 1073741824 Sep 01 02:12:51 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:52 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c 1073741824" returned: 0 in 0.630s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:52 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c Sep 01 02:12:52 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:52 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c" returned: 0 in 0.285s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74252364-d370-4de4-b210-5d5764529748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22da03f-24bb-41bc-a305-8820a13cab8c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de68e2fe-a5f0-48e3-b996-7654b105350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:52 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Volume volume-f22da03f-24bb-41bc-a305-8820a13cab8c (f22da03f-24bb-41bc-a305-8820a13cab8c): created successfully Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de68e2fe-a5f0-48e3-b996-7654b105350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Flow 'volume_create_manager' (b6df4324-3fe8-4090-8d0f-d32336ec8229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1f529c37-a831-4df3-87f7-ed2da4d72b66 tempest-ProjectReaderTests-867644882 None] Created volume successfully. Sep 01 02:12:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Acquiring lock "cinder-f22da03f-24bb-41bc-a305-8820a13cab8c-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Lock "cinder-f22da03f-24bb-41bc-a305-8820a13cab8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Acquiring lock "cinder-quobyte-f22da03f-24bb-41bc-a305-8820a13cab8c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Lock "cinder-quobyte-f22da03f-24bb-41bc-a305-8820a13cab8c" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:54 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3052a-ef21-4bdc-ae88-8f3339992214]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c Sep 01 02:12:54 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:54 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c" returned: 0 in 0.433s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c Sep 01 02:12:54 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f22da03f-24bb-41bc-a305-8820a13cab8c" returned: 0 in 0.294s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Lock "cinder-quobyte-f22da03f-24bb-41bc-a305-8820a13cab8c" released by "delete_volume" :: held 0.783s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Created reservations ['473012cc-cfd5-4ebe-b06a-9368c2f1bdab', '0f03ad72-27c2-4835-bb1c-5645fa0d615a', 'e4c30bdf-86eb-4d47-b9d5-0314c53b8aaf', '1deda2ce-38da-4a13-89fa-d055693e7b1a'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:12:55 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.378s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Deleted volume successfully. Sep 01 02:12:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8c6bfb49-a006-4d9f-a52d-aac0ee81a887 tempest-ProjectReaderTests-867644882 None] Lock "cinder-f22da03f-24bb-41bc-a305-8820a13cab8c-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Flow 'volume_create_manager' (b2cb1e1a-dce1-4429-a8c9-8df70a2f66c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f2b662-7931-46b7-96ed-43805d2e9f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f2b662-7931-46b7-96ed-43805d2e9f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082495350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97037dd0-7740-41f0-bfdf-af8b3bb7a34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f2e18cb87c45b29b6c8a1440b5e14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:56Z,use_quota=True,user_id='8b629d5562b046df948e66aae4d6802d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898aded6-9473-47c4-b2d2-b60b11a945e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (898aded6-9473-47c4-b2d2-b60b11a945e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd2e10d-127a-417a-a03a-93ab4fc6fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd2e10d-127a-417a-a03a-93ab4fc6fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97037dd0-7740-41f0-bfdf-af8b3bb7a34e', 'volume_name': 'volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb54004-843d-4ab2-98d3-d97b4fa7495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb54004-843d-4ab2-98d3-d97b4fa7495f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829e8850-0bdf-4f1f-9198-5771b496cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Volume 97037dd0-7740-41f0-bfdf-af8b3bb7a34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e', 'volume_size': 1} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2082495350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97037dd0-7740-41f0-bfdf-af8b3bb7a34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f2e18cb87c45b29b6c8a1440b5e14d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:56Z,use_quota=True,user_id='8b629d5562b046df948e66aae4d6802d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Creating volume 97037dd0-7740-41f0-bfdf-af8b3bb7a34e {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:56 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:56 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e 1073741824 Sep 01 02:12:56 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (0dac5a0e-4684-4a57-8d24-296a641d1187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447e3630-ee41-4125-a469-cdeb568a3d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447e3630-ee41-4125-a469-cdeb568a3d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1018379939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7074b7d306412b93ae7b6c6a6d5799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:57Z,use_quota=True,user_id='37aa17ad23e748fc8eec673de972de13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7940b4-dc33-468c-a40d-dc3fe52739eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b7940b4-dc33-468c-a40d-dc3fe52739eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09bd16b-93d5-429f-bd36-dc5d70be9b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09bd16b-93d5-429f-bd36-dc5d70be9b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f', 'volume_name': 'volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc96ade8-eb06-4a6e-a4b6-a899569318f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc96ade8-eb06-4a6e-a4b6-a899569318f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89313676-6fc8-4e1e-bce0-5ef7015ce117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Volume 6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f', 'volume_size': 1} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:56 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e 1073741824" returned: 0 in 0.613s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:56 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e Sep 01 02:12:56 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:57 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e" returned: 0 in 0.366s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1018379939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7074b7d306412b93ae7b6c6a6d5799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:57Z,use_quota=True,user_id='37aa17ad23e748fc8eec673de972de13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Creating volume 6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:57 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:57 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f 1073741824 Sep 01 02:12:57 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829e8850-0bdf-4f1f-9198-5771b496cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7597303-2250-451f-9647-2a3b5f49b145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Volume volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e (97037dd0-7740-41f0-bfdf-af8b3bb7a34e): created successfully Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7597303-2250-451f-9647-2a3b5f49b145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Flow 'volume_create_manager' (b2cb1e1a-dce1-4429-a8c9-8df70a2f66c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-26508c92-04d5-46e2-99a3-dd96328d7f22 tempest-ProjectReaderTests-867644882 None] Created volume successfully. Sep 01 02:12:58 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f 1073741824" returned: 0 in 0.771s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:58 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f Sep 01 02:12:58 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Acquiring lock "cinder-97037dd0-7740-41f0-bfdf-af8b3bb7a34e-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Lock "cinder-97037dd0-7740-41f0-bfdf-af8b3bb7a34e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:58 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" returned: 0 in 0.403s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89313676-6fc8-4e1e-bce0-5ef7015ce117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7075445a-4005-4e69-8fc5-8734e29d7250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Acquiring lock "cinder-quobyte-97037dd0-7740-41f0-bfdf-af8b3bb7a34e" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Lock "cinder-quobyte-97037dd0-7740-41f0-bfdf-af8b3bb7a34e" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:58 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Volume volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f (6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f): created successfully Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7075445a-4005-4e69-8fc5-8734e29d7250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (0dac5a0e-4684-4a57-8d24-296a641d1187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f58f06-1d72-449d-9664-0b536bd35a7c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:58 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-021c4a13-caf3-40ea-a93b-dd3156eacaed tempest-VolumesSnapshotTestJSON-1526584885 None] Created volume successfully. Sep 01 02:12:58 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e Sep 01 02:12:58 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e" returned: 0 in 0.676s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:59 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e Sep 01 02:12:59 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Creating offline snapshot c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef of volume 6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[255411d6-171c-4b3b-85a9-a33c25904e90]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:59 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-97037dd0-7740-41f0-bfdf-af8b3bb7a34e" returned: 0 in 0.413s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:59 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f Sep 01 02:12:59 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Lock "cinder-quobyte-97037dd0-7740-41f0-bfdf-af8b3bb7a34e" released by "delete_volume" :: held 1.203s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:59 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Created reservations ['df248a4e-37a9-491f-9ac4-6164cd8d3ea1', '431a055b-7d5c-4d93-9e09-1a34069bcf09', 'c6a676d3-f406-46ec-9816-2cbcd16f6a76', 'feb4de59-6126-4321-96a6-8c82705c75b7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:00 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:00 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" returned: 0 in 0.583s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef 1G Sep 01 02:13:00 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:00 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.348s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Deleted volume successfully. Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a3977c47-0bce-446f-8b68-2e1a79b249bd tempest-ProjectReaderTests-867644882 None] Lock "cinder-97037dd0-7740-41f0-bfdf-af8b3bb7a34e-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:00 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef 1G" returned: 0 in 0.557s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef Sep 01 02:13:00 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:01 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef" returned: 0 in 0.438s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef is being set with open permissions: ugo+rw Sep 01 02:13:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:01 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef Sep 01 02:13:01 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:01 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef" returned: 0 in 0.299s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:01 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.info Sep 01 02:13:01 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:01 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.info" returned: 0 in 0.290s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.info is being set with open permissions: ugo+rw Sep 01 02:13:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:01 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.info Sep 01 02:13:01 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:02 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.info" returned: 0 in 0.316s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:02 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c8b5f510-74e2-460b-9658-2e83a1daf5e3 tempest-VolumesSnapshotTestJSON-1526584885 None] Create snapshot completed successfully Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Deleting offline snapshot c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef of volume 6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] snapshot_file for this snap is: volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b1419-b146-44b3-aefd-4f54e01502fe]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef Sep 01 02:13:03 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef" returned: 0 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf39c1ae-6a41-483c-a363-63ee06a8e6b0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f Sep 01 02:13:03 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" returned: 0 in 0.451s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef Sep 01 02:13:03 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef" returned: 0 in 0.453s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:04 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef Sep 01 02:13:04 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f.c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef" returned: 0 in 0.309s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef" released by "_delete_snapshot" :: held 1.759s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" released by "delete_snapshot" :: held 1.785s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:04 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Created reservations ['59be4e4c-6a75-4bb8-a69a-4cc4e611ad08', '8bd259cb-63a9-4708-ad16-a4c31189f1b7', '47966609-3567-42fd-8edb-7cd3bad22ee1', '9bd9d57f-4083-4482-b370-a87f0711153d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:04 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Delete snapshot completed successfully. Sep 01 02:13:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-965fd475-0a80-45fa-8d55-799204bcca85 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-c660c9a4-6dc1-4ff2-999c-7cbd1d8880ef-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (f4aa2b19-60a4-41a7-a0e9-4292488b4e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad050ee-0d39-4f5e-a02a-8a0fe7d08d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad050ee-0d39-4f5e-a02a-8a0fe7d08d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1353560465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52fbf2d-2dd5-4710-853d-42446ded49cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7074b7d306412b93ae7b6c6a6d5799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:06Z,use_quota=True,user_id='37aa17ad23e748fc8eec673de972de13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d03c4b-6ecc-4fbc-acb3-0da05ceae055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d03c4b-6ecc-4fbc-acb3-0da05ceae055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633e972d-f5c5-4557-9598-c57118370849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633e972d-f5c5-4557-9598-c57118370849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b52fbf2d-2dd5-4710-853d-42446ded49cd', 'volume_name': 'volume-b52fbf2d-2dd5-4710-853d-42446ded49cd', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789afaf8-272d-4419-ad98-aedbe9075bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789afaf8-272d-4419-ad98-aedbe9075bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdf1a33-04a6-4556-8b8c-355d405ddfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:05 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume b52fbf2d-2dd5-4710-853d-42446ded49cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b52fbf2d-2dd5-4710-853d-42446ded49cd', 'volume_size': 1} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1353560465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b52fbf2d-2dd5-4710-853d-42446ded49cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7074b7d306412b93ae7b6c6a6d5799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:06Z,use_quota=True,user_id='37aa17ad23e748fc8eec673de972de13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Creating volume b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:05 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:13:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:05 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd 1073741824 Sep 01 02:13:05 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:06 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:06 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:06 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd 1073741824" returned: 0 in 0.682s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:06 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.400s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:13:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:13:06 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd Sep 01 02:13:06 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:07 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd" returned: 0 in 0.440s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdf1a33-04a6-4556-8b8c-355d405ddfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b52fbf2d-2dd5-4710-853d-42446ded49cd', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd45fc3c-f6af-44b8-b4e4-f47c45b55173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:07 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume volume-b52fbf2d-2dd5-4710-853d-42446ded49cd (b52fbf2d-2dd5-4710-853d-42446ded49cd): created successfully Sep 01 02:13:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd45fc3c-f6af-44b8-b4e4-f47c45b55173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (f4aa2b19-60a4-41a7-a0e9-4292488b4e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:07 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1301d9e3-1091-45c5-95e8-9f5fc7f8be82 tempest-VolumesSnapshotTestJSON-1526584885 None] Created volume successfully. Sep 01 02:13:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Creating offline snapshot 6877bb43-946d-40fd-952a-edf3bfd29c5a of volume b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:08 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e54e20-7132-43fa-9a60-08cea8ef5d2e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:08 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd Sep 01 02:13:08 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:08 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd" returned: 0 in 0.443s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:08 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a 1G Sep 01 02:13:08 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:09 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a 1G" returned: 0 in 0.618s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52fbf2d-2dd5-4710-853d-42446ded49cd -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:09 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52fbf2d-2dd5-4710-853d-42446ded49cd -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a Sep 01 02:13:09 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:09 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b52fbf2d-2dd5-4710-853d-42446ded49cd -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a" returned: 0 in 0.430s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:09 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a is being set with open permissions: ugo+rw Sep 01 02:13:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:09 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a Sep 01 02:13:09 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:10 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a" returned: 0 in 0.315s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:10 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.info Sep 01 02:13:10 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:10 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.info" returned: 0 in 0.548s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:10 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.info is being set with open permissions: ugo+rw Sep 01 02:13:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:10 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.info Sep 01 02:13:10 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:11 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.info" returned: 0 in 0.615s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.118s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d0990be4-2225-49e6-bc1d-9c1acb7cbad2 tempest-VolumesSnapshotTestJSON-1526584885 None] Create snapshot completed successfully Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Flow 'volume_create_manager' (e1ddc784-8b85-48de-a8a8-9bb6a9234038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73daa38-1bb0-4344-a168-912c53a8a252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73daa38-1bb0-4344-a168-912c53a8a252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114463790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295e31a1-898f-4a5d-a30b-c461d8725144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a559d356b704cdd8203bcd4218d379b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:13Z,use_quota=True,user_id='c87d8d8e755e4effb7470d04bae4934e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15e4299-118d-488c-8eb2-31b63038aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15e4299-118d-488c-8eb2-31b63038aecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ba4c5f-8a70-47bd-89d1-f62050d0d2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ba4c5f-8a70-47bd-89d1-f62050d0d2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295e31a1-898f-4a5d-a30b-c461d8725144', 'volume_name': 'volume-295e31a1-898f-4a5d-a30b-c461d8725144', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5b8c24-f2f6-4e08-a224-e73a762bda6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5b8c24-f2f6-4e08-a224-e73a762bda6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd578733-40a6-418f-879a-353e779625a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Volume 295e31a1-898f-4a5d-a30b-c461d8725144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295e31a1-898f-4a5d-a30b-c461d8725144', 'volume_size': 1} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1114463790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295e31a1-898f-4a5d-a30b-c461d8725144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a559d356b704cdd8203bcd4218d379b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:13Z,use_quota=True,user_id='c87d8d8e755e4effb7470d04bae4934e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Creating volume 295e31a1-898f-4a5d-a30b-c461d8725144 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:13 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:13 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 1073741824 Sep 01 02:13:13 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (686ec0ba-992b-4e66-8543-1b0d40360047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4bf1f1-ffc2-464b-933d-d5c78c1617b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4bf1f1-ffc2-464b-933d-d5c78c1617b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1085550529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7074b7d306412b93ae7b6c6a6d5799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6877bb43-946d-40fd-952a-edf3bfd29c5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:13Z,use_quota=True,user_id='37aa17ad23e748fc8eec673de972de13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f50accf-add8-45ce-864d-fd46ed7e166d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f50accf-add8-45ce-864d-fd46ed7e166d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6383657-c8a1-4743-9a3f-56711bcd46f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6383657-c8a1-4743-9a3f-56711bcd46f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212', 'volume_name': 'volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212', 'volume_size': 2, 'snapshot_id': '6877bb43-946d-40fd-952a-edf3bfd29c5a'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1042beef-41b4-4910-90dc-d85078f14301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1042beef-41b4-4910-90dc-d85078f14301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e77a493-bf93-4707-aea7-1a0790c74b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:13 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume 78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212', 'volume_size': 2, 'snapshot_id': '6877bb43-946d-40fd-952a-edf3bfd29c5a'} Sep 01 02:13:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:14 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 1073741824" returned: 0 in 0.547s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 Sep 01 02:13:14 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:14 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144" returned: 0 in 0.375s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.743s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-6877bb43-946d-40fd-952a-edf3bfd29c5a-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd578733-40a6-418f-879a-353e779625a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295e31a1-898f-4a5d-a30b-c461d8725144', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92c9e6f-4072-400d-850d-c540bcc1bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-6877bb43-946d-40fd-952a-edf3bfd29c5a-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Creating volume 78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 from snapshot 6877bb43-946d-40fd-952a-edf3bfd29c5a {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:14 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Volume volume-295e31a1-898f-4a5d-a30b-c461d8725144 (295e31a1-898f-4a5d-a30b-c461d8725144): created successfully Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92c9e6f-4072-400d-850d-c540bcc1bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Flow 'volume_create_manager' (e1ddc784-8b85-48de-a8a8-9bb6a9234038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] snapshot: 6877bb43-946d-40fd-952a-edf3bfd29c5a, volume: 78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:13:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b968d5df-2079-4a34-b646-461bac262a7d tempest-ProjectReaderTests-1136270747 None] Created volume successfully. Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692e529-35d4-4ed9-acfd-f6e4af0e9bc0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a Sep 01 02:13:14 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a" returned: 0 in 0.529s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b52fbf2d-2dd5-4710-853d-42446ded49cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b3c492-6050-4676-82ac-88a45c1da660]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:15 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd Sep 01 02:13:15 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Acquiring lock "cinder-295e31a1-898f-4a5d-a30b-c461d8725144-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Lock "cinder-295e31a1-898f-4a5d-a30b-c461d8725144-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Acquiring lock "cinder-quobyte-295e31a1-898f-4a5d-a30b-c461d8725144" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Lock "cinder-quobyte-295e31a1-898f-4a5d-a30b-c461d8725144" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d78a1c3-31aa-4d51-9f0d-09cae7aebbe6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:15 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd" returned: 0 in 0.586s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:13:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:15 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 Sep 01 02:13:15 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 Sep 01 02:13:15 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:16 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144" returned: 0 in 0.453s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:16 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144 Sep 01 02:13:16 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:16 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-295e31a1-898f-4a5d-a30b-c461d8725144" returned: 0 in 0.412s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Lock "cinder-quobyte-295e31a1-898f-4a5d-a30b-c461d8725144" released by "delete_volume" :: held 0.925s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:16 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Created reservations ['a208f579-01ed-4b3d-8556-c89145e82377', '0b960d4a-c413-4787-bfec-b8238265bdef', 'a2db817c-adb6-470f-b3c2-68f61e259e99', 'e6af018e-4ae1-4b32-bf43-92e40e988c53'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:17 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:17 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:17 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.772s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:17 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:18 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Deleted volume successfully. Sep 01 02:13:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3171fbc7-598c-477a-a651-707bf33bc56d tempest-ProjectReaderTests-1136270747 None] Lock "cinder-295e31a1-898f-4a5d-a30b-c461d8725144-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Flow 'volume_create_manager' (dbd16be3-2a58-4347-a0cb-f3a67a98fc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b19dd1-a764-4886-8e0c-362ec3be3e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b19dd1-a764-4886-8e0c-362ec3be3e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-938231553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c19064-ea61-4155-a61d-e828e1b8f99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a559d356b704cdd8203bcd4218d379b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:20Z,use_quota=True,user_id='c87d8d8e755e4effb7470d04bae4934e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281517bf-ff0b-471c-9813-086d5b7895ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (281517bf-ff0b-471c-9813-086d5b7895ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2541cf1f-1629-455e-9e3d-2953d239673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2541cf1f-1629-455e-9e3d-2953d239673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c19064-ea61-4155-a61d-e828e1b8f99b', 'volume_name': 'volume-d2c19064-ea61-4155-a61d-e828e1b8f99b', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780cd938-3cc3-44cf-bb0b-9d2e342c4990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780cd938-3cc3-44cf-bb0b-9d2e342c4990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfa3355-3c0c-459f-932e-b21c960d43fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Volume d2c19064-ea61-4155-a61d-e828e1b8f99b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c19064-ea61-4155-a61d-e828e1b8f99b', 'volume_size': 1} Sep 01 02:13:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:22 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" returned: 0 in 6.141s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:22 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Converted 1024.00 MB image at 166.66 MB/s Sep 01 02:13:22 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 is being set with open permissions: ugo+rw Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:22 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 Sep 01 02:13:22 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:22 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" returned: 0 in 0.259s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" released by "_copy_volume_from_snapshot" :: held 7.762s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=94,cinder:UPDATE=112,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=133,cinder:SELECT=106,cinder:DELETE=13,cinder:INSERT=40 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-6877bb43-946d-40fd-952a-edf3bfd29c5a-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" released by "_create_volume_from_snapshot" :: held 7.872s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.924s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.422s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-938231553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c19064-ea61-4155-a61d-e828e1b8f99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a559d356b704cdd8203bcd4218d379b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:20Z,use_quota=True,user_id='c87d8d8e755e4effb7470d04bae4934e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Creating volume d2c19064-ea61-4155-a61d-e828e1b8f99b {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:22 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:22 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b 1073741824 Sep 01 02:13:22 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e77a493-bf93-4707-aea7-1a0790c74b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212', 'volume_size': 2, 'snapshot_id': '6877bb43-946d-40fd-952a-edf3bfd29c5a'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6798f1d1-047b-4c06-8028-ad46774ac4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 (78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212): created successfully Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6798f1d1-047b-4c06-8028-ad46774ac4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (686ec0ba-992b-4e66-8543-1b0d40360047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-86dbcc4b-e02e-451a-9ab1-3d8f77dfb111 tempest-VolumesSnapshotTestJSON-1526584885 None] Created volume successfully. Sep 01 02:13:22 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b 1073741824" returned: 0 in 0.445s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:22 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b Sep 01 02:13:22 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:23 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b" returned: 0 in 0.296s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfa3355-3c0c-459f-932e-b21c960d43fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c19064-ea61-4155-a61d-e828e1b8f99b', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e77ced5-3028-4235-b33d-cc22d004c3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Volume volume-d2c19064-ea61-4155-a61d-e828e1b8f99b (d2c19064-ea61-4155-a61d-e828e1b8f99b): created successfully Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e77ced5-3028-4235-b33d-cc22d004c3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Flow 'volume_create_manager' (dbd16be3-2a58-4347-a0cb-f3a67a98fc74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a83bb0e0-cef5-43a3-8c36-b0c2b82f8dcd tempest-ProjectReaderTests-1136270747 None] Created volume successfully. Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[53952d71-7241-4497-a651-d84ee6284d7c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:23 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 Sep 01 02:13:23 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:24 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" returned: 0 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:24 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212 Sep 01 02:13:24 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:24 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" returned: 0 in 0.284s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212" released by "delete_volume" :: held 0.710s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "cinder-d2c19064-ea61-4155-a61d-e828e1b8f99b-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-d2c19064-ea61-4155-a61d-e828e1b8f99b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Created reservations ['217478e7-d49c-4235-9c71-f221a7789db1', '492b2dde-af12-43b3-aaeb-2c100c14f7cb', '267742c7-b440-4ed6-91ee-9087eab2f268', '0100e780-1176-41d5-a7eb-22f3beb21c47'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "cinder-quobyte-d2c19064-ea61-4155-a61d-e828e1b8f99b" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-quobyte-d2c19064-ea61-4155-a61d-e828e1b8f99b" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[696878ee-cc2a-4e6e-b065-0c7719ad3087]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:24 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:24 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:24 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b Sep 01 02:13:24 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-6877bb43-946d-40fd-952a-edf3bfd29c5a-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-6877bb43-946d-40fd-952a-edf3bfd29c5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-b52fbf2d-2dd5-4710-853d-42446ded49cd" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-b52fbf2d-2dd5-4710-853d-42446ded49cd" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-6877bb43-946d-40fd-952a-edf3bfd29c5a" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-6877bb43-946d-40fd-952a-edf3bfd29c5a" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Deleting offline snapshot 6877bb43-946d-40fd-952a-edf3bfd29c5a of volume b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] snapshot_file for this snap is: volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[531fecb7-0cf8-47f1-9c9c-e7eeba3b818d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:24 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.395s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:24 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Deleted volume successfully. Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-81ea47ad-af63-4184-9d64-6feb7f2bc47f tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-78e73fcc-cbd6-4a53-a6c1-e6ca76b6d212-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:25 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b" returned: 0 in 0.508s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:25 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a Sep 01 02:13:25 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:25 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b Sep 01 02:13:25 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:25 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d2c19064-ea61-4155-a61d-e828e1b8f99b" returned: 0 in 0.281s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-quobyte-d2c19064-ea61-4155-a61d-e828e1b8f99b" released by "delete_volume" :: held 0.854s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:25 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a" returned: 0 in 0.472s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b52fbf2d-2dd5-4710-853d-42446ded49cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Created reservations ['c33ab863-c372-40ba-9fb6-f9c9373c87d4', '24f5f8d4-871e-4702-a7ca-90bcb07991ff', '48cdc1f2-7d5a-4330-b4ce-123f4893079a', '132deff6-8c19-4f86-85a4-83c2c6b31d78'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cf75d4-6384-491a-bc37-e6929d407ef1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:25 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:25 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:25 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd Sep 01 02:13:25 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:25 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.340s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Deleted volume successfully. Sep 01 02:13:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b881dab3-41b3-44fe-a423-eaf048e69f79 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-d2c19064-ea61-4155-a61d-e828e1b8f99b-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Flow 'volume_create_manager' (009a92f6-f84c-4f49-a47c-9673d442533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd775211-5593-448f-ba35-9b2003300cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd" returned: 0 in 0.721s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd775211-5593-448f-ba35-9b2003300cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004305323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a068f2-e626-4392-9dc7-ff9b52b76017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a559d356b704cdd8203bcd4218d379b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:26Z,use_quota=True,user_id='c87d8d8e755e4effb7470d04bae4934e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a Sep 01 02:13:26 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9bda38-cb69-4de4-bdce-bbb0901202c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9bda38-cb69-4de4-bdce-bbb0901202c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0e3829-a675-421f-a2b9-2eeab1402655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0e3829-a675-421f-a2b9-2eeab1402655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74a068f2-e626-4392-9dc7-ff9b52b76017', 'volume_name': 'volume-74a068f2-e626-4392-9dc7-ff9b52b76017', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a782e9b4-3ead-4c18-9622-433fcf663a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a782e9b4-3ead-4c18-9622-433fcf663a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451a668b-4953-49df-b8c5-25f146b425cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Volume 74a068f2-e626-4392-9dc7-ff9b52b76017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74a068f2-e626-4392-9dc7-ff9b52b76017', 'volume_size': 1} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004305323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a068f2-e626-4392-9dc7-ff9b52b76017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a559d356b704cdd8203bcd4218d379b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:26Z,use_quota=True,user_id='c87d8d8e755e4effb7470d04bae4934e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Creating volume 74a068f2-e626-4392-9dc7-ff9b52b76017 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:26 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:26 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 1073741824 Sep 01 02:13:26 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:26 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a" returned: 0 in 0.373s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:26 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a Sep 01 02:13:26 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:26 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 1073741824" returned: 0 in 0.473s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:26 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 Sep 01 02:13:26 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:26 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd.6877bb43-946d-40fd-952a-edf3bfd29c5a" returned: 0 in 0.283s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-6877bb43-946d-40fd-952a-edf3bfd29c5a" released by "_delete_snapshot" :: held 1.985s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-b52fbf2d-2dd5-4710-853d-42446ded49cd" released by "delete_snapshot" :: held 2.020s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:26 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Created reservations ['cde802b2-51e4-40e6-8edd-21a5784ddaa5', '54c15d42-987c-4aba-828c-28da5c5f14e3', 'acb9faf4-b03f-4417-8d6e-1eb283bd7b14', 'f8a49ec8-02c4-496d-8787-ef12f2cd53d3'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Delete snapshot completed successfully. Sep 01 02:13:27 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7fd85c11-b803-465e-8698-3e4c577212ea tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-6877bb43-946d-40fd-952a-edf3bfd29c5a-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451a668b-4953-49df-b8c5-25f146b425cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74a068f2-e626-4392-9dc7-ff9b52b76017', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246c6188-9620-4561-8f3f-8d233f7316e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:27 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Volume volume-74a068f2-e626-4392-9dc7-ff9b52b76017 (74a068f2-e626-4392-9dc7-ff9b52b76017): created successfully Sep 01 02:13:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246c6188-9620-4561-8f3f-8d233f7316e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Flow 'volume_create_manager' (009a92f6-f84c-4f49-a47c-9673d442533e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-66a4076c-a766-4b38-bedf-393080f53d12 tempest-ProjectReaderTests-1136270747 None] Created volume successfully. Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-b52fbf2d-2dd5-4710-853d-42446ded49cd-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-b52fbf2d-2dd5-4710-853d-42446ded49cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-b52fbf2d-2dd5-4710-853d-42446ded49cd" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-b52fbf2d-2dd5-4710-853d-42446ded49cd" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f0559-fdb2-4ca6-9fc4-122566ba6427]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "cinder-74a068f2-e626-4392-9dc7-ff9b52b76017-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:28 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-74a068f2-e626-4392-9dc7-ff9b52b76017-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:28 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "cinder-quobyte-74a068f2-e626-4392-9dc7-ff9b52b76017" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-quobyte-74a068f2-e626-4392-9dc7-ff9b52b76017" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[455e13e1-7f12-48e5-82fa-07296218b426]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 Sep 01 02:13:28 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd" returned: 0 in 0.427s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd Sep 01 02:13:28 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017" returned: 0 in 0.421s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017 Sep 01 02:13:28 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b52fbf2d-2dd5-4710-853d-42446ded49cd" returned: 0 in 0.277s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-b52fbf2d-2dd5-4710-853d-42446ded49cd" released by "delete_volume" :: held 0.782s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Created reservations ['8910a483-0555-4f56-9f3f-3905960d83c9', '010f981d-f63d-49c3-ac4a-6388e774a458', '379f728c-1f2a-4429-821e-fdd18ecad164', '13f224f0-eebe-484b-b897-c29ff324d40e'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:29 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:29 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:29 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-74a068f2-e626-4392-9dc7-ff9b52b76017" returned: 0 in 0.340s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-quobyte-74a068f2-e626-4392-9dc7-ff9b52b76017" released by "delete_volume" :: held 0.824s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Created reservations ['60b81e17-44d6-4aee-ba27-1871ec874a6f', '67843dec-967f-494b-9ded-43c1d67a866b', '8625aece-9f8a-4d7d-ab1b-67cf935556e9', '8d3bccb0-1e39-4b8d-989c-8e4670db41b8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:29 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.393s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Deleted volume successfully. Sep 01 02:13:29 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:29 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-dd84c62d-24ba-4a95-87d3-3012ea49be67 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-b52fbf2d-2dd5-4710-853d-42446ded49cd-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:29 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.357s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Deleted volume successfully. Sep 01 02:13:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d427928a-0333-4955-b0d9-c3e037ae81c0 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-74a068f2-e626-4392-9dc7-ff9b52b76017-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (3b9aa023-e211-48ab-8e9e-556bf50a1b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e6d69c-bf4e-47e9-8ab4-039cd9f90787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e6d69c-bf4e-47e9-8ab4-039cd9f90787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1271810059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ce8010-fbab-4171-9a26-25252a0a3f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7074b7d306412b93ae7b6c6a6d5799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:30Z,use_quota=True,user_id='37aa17ad23e748fc8eec673de972de13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d53b27-bfc9-4bb5-b14c-4ac7330983ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d53b27-bfc9-4bb5-b14c-4ac7330983ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3332ce-7e29-47ce-86bb-764ab0c7944b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d3332ce-7e29-47ce-86bb-764ab0c7944b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ce8010-fbab-4171-9a26-25252a0a3f4d', 'volume_name': 'volume-88ce8010-fbab-4171-9a26-25252a0a3f4d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a629a886-b8e9-4407-9b30-e0c1db8596b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a629a886-b8e9-4407-9b30-e0c1db8596b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4f7897-4707-4b48-ad93-7b29d9301d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume 88ce8010-fbab-4171-9a26-25252a0a3f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ce8010-fbab-4171-9a26-25252a0a3f4d', 'volume_size': 1} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1271810059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ce8010-fbab-4171-9a26-25252a0a3f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7074b7d306412b93ae7b6c6a6d5799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:30Z,use_quota=True,user_id='37aa17ad23e748fc8eec673de972de13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Creating volume 88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:30 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:30 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d 1073741824 Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:30 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Flow 'volume_create_manager' (960ce54f-59b8-42ad-964e-89d1e55980b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d768ae6d-e326-42f7-ad8c-776c032c3d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d768ae6d-e326-42f7-ad8c-776c032c3d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082302852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b76c58-1912-48c0-bbdb-a60eaa465c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a559d356b704cdd8203bcd4218d379b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:30Z,use_quota=True,user_id='c87d8d8e755e4effb7470d04bae4934e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c675524-0cd0-42bb-9724-473a7703e4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c675524-0cd0-42bb-9724-473a7703e4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45cc60e-fbe2-409d-9919-1d8fa84426bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45cc60e-fbe2-409d-9919-1d8fa84426bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b76c58-1912-48c0-bbdb-a60eaa465c32', 'volume_name': 'volume-83b76c58-1912-48c0-bbdb-a60eaa465c32', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8a069b-e63c-427b-bc18-159263c32f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8a069b-e63c-427b-bc18-159263c32f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1e3bcb-33b3-4584-a761-80e0b6e640d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:30 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Volume 83b76c58-1912-48c0-bbdb-a60eaa465c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b76c58-1912-48c0-bbdb-a60eaa465c32', 'volume_size': 1} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:30 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d 1073741824" returned: 0 in 0.478s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:30 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d Sep 01 02:13:30 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:31 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d" returned: 0 in 0.297s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082302852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b76c58-1912-48c0-bbdb-a60eaa465c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a559d356b704cdd8203bcd4218d379b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:30Z,use_quota=True,user_id='c87d8d8e755e4effb7470d04bae4934e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Creating volume 83b76c58-1912-48c0-bbdb-a60eaa465c32 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:31 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f4f7897-4707-4b48-ad93-7b29d9301d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ce8010-fbab-4171-9a26-25252a0a3f4d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a655fbe6-baea-4afe-9e88-5322d2ebdb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:31 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 1073741824 Sep 01 02:13:31 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:31 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume volume-88ce8010-fbab-4171-9a26-25252a0a3f4d (88ce8010-fbab-4171-9a26-25252a0a3f4d): created successfully Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a655fbe6-baea-4afe-9e88-5322d2ebdb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (3b9aa023-e211-48ab-8e9e-556bf50a1b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d1365f3b-be7d-4b71-85f1-25ca966b5952 tempest-VolumesSnapshotTestJSON-1526584885 None] Created volume successfully. Sep 01 02:13:31 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 1073741824" returned: 0 in 0.549s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:31 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 Sep 01 02:13:31 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1e3bcb-33b3-4584-a761-80e0b6e640d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b76c58-1912-48c0-bbdb-a60eaa465c32', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c846866-462f-4205-a2e6-ea126c362b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:32 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Volume volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 (83b76c58-1912-48c0-bbdb-a60eaa465c32): created successfully Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c846866-462f-4205-a2e6-ea126c362b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Flow 'volume_create_manager' (960ce54f-59b8-42ad-964e-89d1e55980b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3d6da968-9973-4765-aaa9-1101d525d929 tempest-ProjectReaderTests-1136270747 None] Created volume successfully. Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "cinder-83b76c58-1912-48c0-bbdb-a60eaa465c32-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-83b76c58-1912-48c0-bbdb-a60eaa465c32-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Creating offline snapshot bbb25c28-43d2-4db9-a2b0-e145186d3249 of volume 88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "cinder-quobyte-83b76c58-1912-48c0-bbdb-a60eaa465c32" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ab4bfd-925c-400a-a179-19cc14e09411]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-quobyte-83b76c58-1912-48c0-bbdb-a60eaa465c32" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58331f9-1870-40dd-bda1-73b5d537fcbe]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d Sep 01 02:13:32 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 Sep 01 02:13:32 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d" returned: 0 in 0.400s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 1G Sep 01 02:13:32 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32" returned: 0 in 0.439s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32 Sep 01 02:13:33 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-83b76c58-1912-48c0-bbdb-a60eaa465c32" returned: 0 in 0.328s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-quobyte-83b76c58-1912-48c0-bbdb-a60eaa465c32" released by "delete_volume" :: held 0.808s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:33 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Created reservations ['ea98a2a5-8088-4178-8809-38c76031a3eb', '7cb1613e-ef2a-4512-8f74-9a9bbd049a13', '2fbcac2d-3512-4233-9e25-97d8a086c3eb', '7667ae90-8b7f-4af8-9159-a3ba7b8988da'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 1G" returned: 0 in 0.479s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ce8010-fbab-4171-9a26-25252a0a3f4d -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ce8010-fbab-4171-9a26-25252a0a3f4d -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 Sep 01 02:13:33 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:33 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88ce8010-fbab-4171-9a26-25252a0a3f4d -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249" returned: 0 in 0.342s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 is being set with open permissions: ugo+rw Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 Sep 01 02:13:33 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.307s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:33 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Deleted volume successfully. Sep 01 02:13:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0ac2dad1-cc64-4029-9b20-8ba494fba8f4 tempest-ProjectReaderTests-1136270747 None] Lock "cinder-83b76c58-1912-48c0-bbdb-a60eaa465c32-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:34 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249" returned: 0 in 0.314s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:34 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.info Sep 01 02:13:34 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.info" returned: 0 in 0.295s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.info is being set with open permissions: ugo+rw Sep 01 02:13:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:34 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.info Sep 01 02:13:34 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.info" returned: 0 in 0.280s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6e9c1414-7753-46e4-981a-612324b7e11a tempest-VolumesSnapshotTestJSON-1526584885 None] Create snapshot completed successfully Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Flow 'volume_create_manager' (d3a7c368-6d1b-42a4-a97a-551d9a468a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6facde77-8977-4dbd-b629-19e6a5ae9860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6facde77-8977-4dbd-b629-19e6a5ae9860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1277528455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1a0d52-765f-4885-b03a-cbd1677aa6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca869efaa1dc47bb83e5bd08b0a19a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:36Z,use_quota=True,user_id='39246a5ddd8a4befa6770b567087b93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b01648-6193-40f1-8dcd-a6988114bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b01648-6193-40f1-8dcd-a6988114bf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfda50c-f2a9-4d32-b81d-2bd9c406213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfda50c-f2a9-4d32-b81d-2bd9c406213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1a0d52-765f-4885-b03a-cbd1677aa6ae', 'volume_name': 'volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c53ee1e-1468-4da4-9c6a-298ea3be5c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c53ee1e-1468-4da4-9c6a-298ea3be5c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4cea38-64df-497d-af71-4079b7eeb4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:35 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Volume 6f1a0d52-765f-4885-b03a-cbd1677aa6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae', 'volume_size': 1} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1277528455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1a0d52-765f-4885-b03a-cbd1677aa6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca869efaa1dc47bb83e5bd08b0a19a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:36Z,use_quota=True,user_id='39246a5ddd8a4befa6770b567087b93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Creating volume 6f1a0d52-765f-4885-b03a-cbd1677aa6ae {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:35 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:13:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:35 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae 1073741824 Sep 01 02:13:35 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:36 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae 1073741824" returned: 0 in 0.563s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:36 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae Sep 01 02:13:36 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (41144407-e0d4-46a0-a5e8-21b3d14c06f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d75d63f-6888-47b0-aaf2-1952f9bbb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d75d63f-6888-47b0-aaf2-1952f9bbb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-585130491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef25da8-b39c-4490-941e-6d9a66dcd956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7074b7d306412b93ae7b6c6a6d5799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bbb25c28-43d2-4db9-a2b0-e145186d3249,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:36Z,use_quota=True,user_id='37aa17ad23e748fc8eec673de972de13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc15419-d394-40a5-a932-5236f47a8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc15419-d394-40a5-a932-5236f47a8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2620b927-6340-425a-977a-67a3296c28de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2620b927-6340-425a-977a-67a3296c28de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cef25da8-b39c-4490-941e-6d9a66dcd956', 'volume_name': 'volume-cef25da8-b39c-4490-941e-6d9a66dcd956', 'volume_size': 1, 'snapshot_id': 'bbb25c28-43d2-4db9-a2b0-e145186d3249'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4f16be-5f1a-43bc-90f3-26aeac9ad34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc4f16be-5f1a-43bc-90f3-26aeac9ad34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fbe971-b05e-4507-83f9-12895111e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume cef25da8-b39c-4490-941e-6d9a66dcd956: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cef25da8-b39c-4490-941e-6d9a66dcd956', 'volume_size': 1, 'snapshot_id': 'bbb25c28-43d2-4db9-a2b0-e145186d3249'} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:36 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae" returned: 0 in 0.265s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.127s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-bbb25c28-43d2-4db9-a2b0-e145186d3249-cef25da8-b39c-4490-941e-6d9a66dcd956" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4cea38-64df-497d-af71-4079b7eeb4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c623b2b-7e3f-4e5c-859c-42b868f1dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-bbb25c28-43d2-4db9-a2b0-e145186d3249-cef25da8-b39c-4490-941e-6d9a66dcd956" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Creating volume cef25da8-b39c-4490-941e-6d9a66dcd956 from snapshot bbb25c28-43d2-4db9-a2b0-e145186d3249 {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-cef25da8-b39c-4490-941e-6d9a66dcd956" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:36 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Volume volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae (6f1a0d52-765f-4885-b03a-cbd1677aa6ae): created successfully Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c623b2b-7e3f-4e5c-859c-42b868f1dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Flow 'volume_create_manager' (d3a7c368-6d1b-42a4-a97a-551d9a468a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-cef25da8-b39c-4490-941e-6d9a66dcd956" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] snapshot: bbb25c28-43d2-4db9-a2b0-e145186d3249, volume: cef25da8-b39c-4490-941e-6d9a66dcd956, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:13:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-90749adb-2fab-4c7b-a196-6b2d6fbf0d9a tempest-AttachVolumeNegativeTest-1604580437 None] Created volume successfully. Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba25d0b9-ca88-4876-8c17-86947c688420]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:36 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 Sep 01 02:13:36 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:37 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88ce8010-fbab-4171-9a26-25252a0a3f4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9182aee-71e3-4c1d-a1be-5659fa293d1f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:37 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d Sep 01 02:13:37 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:37 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:13:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:37 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 Sep 01 02:13:37 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-eee416d7-7576-4695-bcec-b81c604b63fd req-3c5db1d8-2d9e-418f-b662-8343f9473ffd tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:41 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956" returned: 0 in 4.464s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:41 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:41 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Converted 1024.00 MB image at 229.32 MB/s Sep 01 02:13:41 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 is being set with open permissions: ugo+rw Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:42 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 Sep 01 02:13:42 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:42 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956" returned: 0 in 0.250s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-cef25da8-b39c-4490-941e-6d9a66dcd956" released by "_copy_volume_from_snapshot" :: held 5.590s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-bbb25c28-43d2-4db9-a2b0-e145186d3249-cef25da8-b39c-4490-941e-6d9a66dcd956" released by "_create_volume_from_snapshot" :: held 5.666s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.697s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-eee416d7-7576-4695-bcec-b81c604b63fd req-3c5db1d8-2d9e-418f-b662-8343f9473ffd tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.914s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-eee416d7-7576-4695-bcec-b81c604b63fd req-3c5db1d8-2d9e-418f-b662-8343f9473ffd tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fbe971-b05e-4507-83f9-12895111e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef25da8-b39c-4490-941e-6d9a66dcd956', 'volume_size': 1, 'snapshot_id': 'bbb25c28-43d2-4db9-a2b0-e145186d3249'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa5d293-b395-405c-830d-f1ea0f9b9b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:42 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Volume volume-cef25da8-b39c-4490-941e-6d9a66dcd956 (cef25da8-b39c-4490-941e-6d9a66dcd956): created successfully Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa5d293-b395-405c-830d-f1ea0f9b9b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Flow 'volume_create_manager' (41144407-e0d4-46a0-a5e8-21b3d14c06f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-eee416d7-7576-4695-bcec-b81c604b63fd req-3c5db1d8-2d9e-418f-b662-8343f9473ffd tempest-AttachVolumeNegativeTest-1604580437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dab14680-1969-4aef-8aff-46d3abbd65c0', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:13:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ba5cbc84-28a8-4bcf-86d6-4fb26b1b55a1 tempest-VolumesSnapshotTestJSON-1526584885 None] Created volume successfully. Sep 01 02:13:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-eee416d7-7576-4695-bcec-b81c604b63fd req-3c5db1d8-2d9e-418f-b662-8343f9473ffd tempest-AttachVolumeNegativeTest-1604580437 None] attachment_update completed successfully. Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-cef25da8-b39c-4490-941e-6d9a66dcd956-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-cef25da8-b39c-4490-941e-6d9a66dcd956-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-cef25da8-b39c-4490-941e-6d9a66dcd956" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-cef25da8-b39c-4490-941e-6d9a66dcd956" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b21c9e-2044-4130-989d-4c4e562654ae]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:43 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 Sep 01 02:13:43 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:43 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956" returned: 0 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:43 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956 Sep 01 02:13:43 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:43 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-cef25da8-b39c-4490-941e-6d9a66dcd956" returned: 0 in 0.276s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-cef25da8-b39c-4490-941e-6d9a66dcd956" released by "delete_volume" :: held 0.710s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:43 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Created reservations ['69055bb6-6792-449b-9959-2e44ab9594b0', 'bdf82f5b-39be-4c75-b5f4-a6b8d4038af4', '98bb26d8-ce6f-406b-8ba0-2833f0f60d47', 'd520b9fd-fe71-4b38-8aea-e05632a52c8f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:44 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:44 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:44 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.297s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:44 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Deleted volume successfully. Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-bbb25c28-43d2-4db9-a2b0-e145186d3249-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4c93b4e3-f9dd-4520-9a41-e11f37706c8e tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-cef25da8-b39c-4490-941e-6d9a66dcd956-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-bbb25c28-43d2-4db9-a2b0-e145186d3249-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-88ce8010-fbab-4171-9a26-25252a0a3f4d" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-88ce8010-fbab-4171-9a26-25252a0a3f4d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-bbb25c28-43d2-4db9-a2b0-e145186d3249" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-bbb25c28-43d2-4db9-a2b0-e145186d3249" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Deleting offline snapshot bbb25c28-43d2-4db9-a2b0-e145186d3249 of volume 88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] snapshot_file for this snap is: volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69ca3e7-6dd1-4f9d-9010-a162266b9921]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:44 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 Sep 01 02:13:44 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:44 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249" returned: 0 in 0.400s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88ce8010-fbab-4171-9a26-25252a0a3f4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe6295-444f-4766-a38b-6cf896ef4483]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d Sep 01 02:13:45 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d" returned: 0 in 0.598s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 Sep 01 02:13:45 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249" returned: 0 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249 Sep 01 02:13:45 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:46 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d.bbb25c28-43d2-4db9-a2b0-e145186d3249" returned: 0 in 0.276s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-bbb25c28-43d2-4db9-a2b0-e145186d3249" released by "_delete_snapshot" :: held 1.791s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-88ce8010-fbab-4171-9a26-25252a0a3f4d" released by "delete_snapshot" :: held 1.814s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Created reservations ['83302810-45c8-4c97-ad73-470c6b496265', '890c1796-59f8-4aeb-ac95-ddf7a8bd39ca', 'f58b3b4b-c342-4b9a-9955-9694345b52c4', '79f30408-4ac7-48d9-bb50-38724c8c6a9a'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Delete snapshot completed successfully. Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-630e9f8f-4b40-44ce-93d5-f03bf0498e32 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-bbb25c28-43d2-4db9-a2b0-e145186d3249-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-88ce8010-fbab-4171-9a26-25252a0a3f4d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-88ce8010-fbab-4171-9a26-25252a0a3f4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-88ce8010-fbab-4171-9a26-25252a0a3f4d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-88ce8010-fbab-4171-9a26-25252a0a3f4d" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[874041fd-b10e-4320-bce0-26fa387f47b5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:46 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d Sep 01 02:13:46 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:47 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d" returned: 0 in 0.408s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:47 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d Sep 01 02:13:47 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:47 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88ce8010-fbab-4171-9a26-25252a0a3f4d" returned: 0 in 0.297s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-88ce8010-fbab-4171-9a26-25252a0a3f4d" released by "delete_volume" :: held 0.773s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Created reservations ['27b84562-9cfa-4687-a0c3-1949edd4f8d8', '951b74eb-a00e-48cb-b455-feee6ccd4bfb', '1a1cb806-4227-4fa6-aa39-b1a390c9f8d4', 'b28028c7-df31-4453-8a81-36687767dbd5'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:47 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:47 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:47 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.324s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Deleted volume successfully. Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "cinder-quobyte-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ef9e783e-8c4b-47e8-beb1-495230222834 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-88ce8010-fbab-4171-9a26-25252a0a3f4d-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe484c11-a495-4820-9095-8b6958882a6d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:48 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f Sep 01 02:13:48 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:48 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" returned: 0 in 0.513s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:48 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f Sep 01 02:13:48 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:48 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" returned: 0 in 0.353s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-quobyte-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f" released by "delete_volume" :: held 0.993s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Created reservations ['a83f78ea-b1e1-4d92-b01c-d367e4879204', '03e4edb7-f1eb-4d74-ba56-7059da09cb3c', 'f3d60e58-e66b-4a04-9298-ed11fcb681df', '3a5010ac-f7d9-40eb-85da-9b68425c216c'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:49 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:13:49 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:49 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.345s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:49 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Deleted volume successfully. Sep 01 02:13:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d64b00f-e4e9-47e7-829f-bf33940f1240 tempest-VolumesSnapshotTestJSON-1526584885 None] Lock "cinder-6cc4e1fc-63ff-41f8-9b00-3643ffa45a8f-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Flow 'volume_create_manager' (6e22a51a-7ca1-4fb1-a5c9-8404730eb532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a85938-14b1-448f-8466-f7780631accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a85938-14b1-448f-8466-f7780631accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1159450968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31ee46d-e5e2-4d7f-a5b7-f62e887138e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4651edd4ab4f6e8fce2e13e4b2dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:59Z,use_quota=True,user_id='a6f38aa69c0a4b95a5d72122d8decd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d5aa67-7993-4a53-87b9-81e11c39793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d5aa67-7993-4a53-87b9-81e11c39793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353365c4-e956-4598-a95d-e0eccc89ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353365c4-e956-4598-a95d-e0eccc89ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f31ee46d-e5e2-4d7f-a5b7-f62e887138e3', 'volume_name': 'volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db94add3-3ba4-4052-9232-3328d3ed83e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db94add3-3ba4-4052-9232-3328d3ed83e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9e526f-5ed1-4578-85b5-927b27072f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:58 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Volume f31ee46d-e5e2-4d7f-a5b7-f62e887138e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3', 'volume_size': 1} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1159450968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f31ee46d-e5e2-4d7f-a5b7-f62e887138e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4651edd4ab4f6e8fce2e13e4b2dd09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:59Z,use_quota=True,user_id='a6f38aa69c0a4b95a5d72122d8decd03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Creating volume f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:58 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:13:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:58 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 1073741824 Sep 01 02:13:58 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:59 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 1073741824" returned: 0 in 0.469s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:59 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 Sep 01 02:13:59 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:59 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9e526f-5ed1-4578-85b5-927b27072f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ea3f6c-f042-4736-9499-b9f75a050d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Volume volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 (f31ee46d-e5e2-4d7f-a5b7-f62e887138e3): created successfully Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ea3f6c-f042-4736-9499-b9f75a050d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Flow 'volume_create_manager' (6e22a51a-7ca1-4fb1-a5c9-8404730eb532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-254dfce9-a304-4d77-8cee-8c91cb3c2574 tempest-VolumesSnapshotListTestJSON-930515848 None] Created volume successfully. Sep 01 02:14:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Creating offline snapshot e764603d-08e5-49a8-931e-05901f170222 of volume f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[618158e6-7cff-491c-9648-39b3e57baad3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:01 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 Sep 01 02:14:01 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:01 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" returned: 0 in 0.396s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:01 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 1G Sep 01 02:14:01 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 1G" returned: 0 in 0.472s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 Sep 01 02:14:02 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222" returned: 0 in 0.347s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 is being set with open permissions: ugo+rw Sep 01 02:14:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 Sep 01 02:14:02 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222" returned: 0 in 0.300s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.info Sep 01 02:14:02 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:02 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.info" returned: 0 in 0.267s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:02 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.info is being set with open permissions: ugo+rw Sep 01 02:14:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.info Sep 01 02:14:03 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:03 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.info" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:03 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f86430ed-b6f4-4f51-b5c2-e94bff6f9c0b tempest-VolumesSnapshotListTestJSON-930515848 None] Create snapshot completed successfully Sep 01 02:14:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Creating offline snapshot 1021d9fb-19b5-4e50-8ad0-e940a303221b of volume f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:04 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c6245-7d7e-4f11-8b09-d0ace8a22836]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:04 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 Sep 01 02:14:04 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:05 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222" returned: 0 in 0.420s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:05 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b 1G Sep 01 02:14:05 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:05 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b 1G" returned: 0 in 0.510s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:05 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b Sep 01 02:14:05 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:05 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b" returned: 0 in 0.375s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:05 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b is being set with open permissions: ugo+rw Sep 01 02:14:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:05 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b Sep 01 02:14:05 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:06 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b" returned: 0 in 0.277s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.689s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a4f41a2c-4166-4311-82d5-49ee56958a60 tempest-VolumesSnapshotListTestJSON-930515848 None] Create snapshot completed successfully Sep 01 02:14:06 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:14:06 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:06 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.264s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Creating offline snapshot 06bfe8f9-f3a9-4f20-852a-b75420b8c305 of volume f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a447c259-72b7-45d5-bc13-6e1bce29be1c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b Sep 01 02:14:07 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:07 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b" returned: 0 in 0.385s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 1G Sep 01 02:14:07 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:07 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 1G" returned: 0 in 0.505s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 Sep 01 02:14:07 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305" returned: 0 in 0.323s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 is being set with open permissions: ugo+rw Sep 01 02:14:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:08 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 Sep 01 02:14:08 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305" returned: 0 in 0.252s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.572s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-28af1285-df22-400a-a34a-11f332f9bfcd tempest-VolumesSnapshotListTestJSON-930515848 None] Create snapshot completed successfully Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-06bfe8f9-f3a9-4f20-852a-b75420b8c305-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-06bfe8f9-f3a9-4f20-852a-b75420b8c305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-quobyte-06bfe8f9-f3a9-4f20-852a-b75420b8c305" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-06bfe8f9-f3a9-4f20-852a-b75420b8c305" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Deleting offline snapshot 06bfe8f9-f3a9-4f20-852a-b75420b8c305 of volume f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] snapshot_file for this snap is: volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5680f0b0-64f5-4a24-aae8-d785ee7da4b8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:10 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 Sep 01 02:14:10 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:10 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305" returned: 0 in 0.386s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:10 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9788046b-f8a5-491a-b1aa-93e82c1c9623]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:10 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b Sep 01 02:14:10 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:10 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b" returned: 0 in 0.377s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:10 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 Sep 01 02:14:10 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:11 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305" returned: 0 in 0.444s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:11 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305 Sep 01 02:14:11 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:11 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.06bfe8f9-f3a9-4f20-852a-b75420b8c305" returned: 0 in 0.263s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-06bfe8f9-f3a9-4f20-852a-b75420b8c305" released by "_delete_snapshot" :: held 1.563s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" released by "delete_snapshot" :: held 1.592s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:11 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Created reservations ['89b68d89-de7e-4241-9328-a9b587a8263d', '1ef41bfa-cf4a-48aa-be5a-99a853d549b7', 'fbbc35db-68f2-4b47-b99e-3cb6bf044482', '94db1641-097a-408c-9aa5-78bbbda8f3dc'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Delete snapshot completed successfully. Sep 01 02:14:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0e2fcc2a-8bf8-41d4-aad7-e0aa18c36463 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-06bfe8f9-f3a9-4f20-852a-b75420b8c305-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-1021d9fb-19b5-4e50-8ad0-e940a303221b-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-1021d9fb-19b5-4e50-8ad0-e940a303221b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-quobyte-1021d9fb-19b5-4e50-8ad0-e940a303221b" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-1021d9fb-19b5-4e50-8ad0-e940a303221b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Deleting offline snapshot 1021d9fb-19b5-4e50-8ad0-e940a303221b of volume f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] snapshot_file for this snap is: volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[89433480-fe37-402f-98e0-d56c66a9e835]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:12 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b Sep 01 02:14:12 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:12 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b" returned: 0 in 0.387s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc38cf6-2573-4c01-ba3f-9fd31eb16e21]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:12 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 Sep 01 02:14:12 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:12 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222" returned: 0 in 0.373s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:12 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b Sep 01 02:14:12 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:13 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b" returned: 0 in 0.428s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:13 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b Sep 01 02:14:13 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:13 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.1021d9fb-19b5-4e50-8ad0-e940a303221b" returned: 0 in 0.250s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-1021d9fb-19b5-4e50-8ad0-e940a303221b" released by "_delete_snapshot" :: held 1.555s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" released by "delete_snapshot" :: held 1.586s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:13 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Created reservations ['74da5929-81cf-4a09-97ff-9106b1fd14b9', 'fed6281a-74e5-4ac9-ae8b-bbf45f5b3123', '8eeb9ec6-abbc-476c-9517-bd4a152cd28c', '5a5a97ad-2ff9-4990-ac87-63162bc0b9bc'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Delete snapshot completed successfully. Sep 01 02:14:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-90edbdf0-babb-47fe-877b-1fc1655318fe tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-1021d9fb-19b5-4e50-8ad0-e940a303221b-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-e764603d-08e5-49a8-931e-05901f170222-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-e764603d-08e5-49a8-931e-05901f170222-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-quobyte-e764603d-08e5-49a8-931e-05901f170222" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-e764603d-08e5-49a8-931e-05901f170222" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Deleting offline snapshot e764603d-08e5-49a8-931e-05901f170222 of volume f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] snapshot_file for this snap is: volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c27742-2e5d-43b1-b9ed-6159f938f956]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:14 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 Sep 01 02:14:14 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:14 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222" returned: 0 in 0.438s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6069fb-eae1-488a-a295-c9f1c7331437]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:14 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 Sep 01 02:14:14 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:15 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" returned: 0 in 0.439s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:15 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 Sep 01 02:14:15 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:15 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222" returned: 0 in 0.347s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:15 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222 Sep 01 02:14:15 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:15 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3.e764603d-08e5-49a8-931e-05901f170222" returned: 0 in 0.269s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-e764603d-08e5-49a8-931e-05901f170222" released by "_delete_snapshot" :: held 1.605s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" released by "delete_snapshot" :: held 1.631s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Created reservations ['610366bf-d249-4c81-8b03-86aae8a37122', 'ca30e787-b7ab-4085-9e76-0ad5bc16676b', 'c8d21235-e436-44af-a70d-0e230d028bea', '2d3beb85-a1ea-4b80-9eb6-1d28d4ecb965'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Delete snapshot completed successfully. Sep 01 02:14:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a7b131c7-e64a-4080-82bd-a8813b4ac2f3 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-e764603d-08e5-49a8-931e-05901f170222-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:16 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bea7b9-5c36-4f35-9d39-9edecc9e8356]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:16 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 Sep 01 02:14:16 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:16 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" returned: 0 in 0.417s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:17 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3 Sep 01 02:14:17 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:17 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" returned: 0 in 0.297s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-quobyte-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3" released by "delete_volume" :: held 0.784s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Created reservations ['36f70e0a-b911-4f97-9537-e112bc90ec33', '593492c8-db77-4518-853c-cb9e1f6b8061', 'b4a722e0-9524-41e1-8a49-defb0ffd5a12', '3f7add9a-810b-4ae4-ba8c-2cd3a5883a64'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:17 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:14:17 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:17 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.419s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Deleted volume successfully. Sep 01 02:14:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-370c3959-b196-4520-b6cb-ee6b3e653971 tempest-VolumesSnapshotListTestJSON-930515848 None] Lock "cinder-f31ee46d-e5e2-4d7f-a5b7-f62e887138e3-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-05581c01-6650-4295-b369-8ab898148d3c req-01d40eb1-a264-4fb1-9465-20671cb439ff tempest-AttachVolumeNegativeTest-1604580437 None] Terminate volume connection completed successfully. Sep 01 02:14:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-05581c01-6650-4295-b369-8ab898148d3c req-01d40eb1-a264-4fb1-9465-20671cb439ff tempest-AttachVolumeNegativeTest-1604580437 None] Deleting attachment dab14680-1969-4aef-8aff-46d3abbd65c0. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Flow 'volume_create_manager' (f50a54b9-8196-4056-880d-bcf015558a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f297cde8-b816-43c5-8563-a33b7d7758dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f297cde8-b816-43c5-8563-a33b7d7758dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1650806965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6480f2-159f-4d5b-b876-495a92cca55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fb2dd9d2d14ccc98a167856fcae8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:22Z,use_quota=True,user_id='d31b4f4821b245ea90f803e97b6de7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa761706-ad6a-4c87-bc7d-41e8d535cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa761706-ad6a-4c87-bc7d-41e8d535cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351ec29d-7230-4b0e-8be4-a2b86bdc92c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351ec29d-7230-4b0e-8be4-a2b86bdc92c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6480f2-159f-4d5b-b876-495a92cca55c', 'volume_name': 'volume-7b6480f2-159f-4d5b-b876-495a92cca55c', 'volume_size': 2}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d259b02-9527-4733-9981-7237ece545c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d259b02-9527-4733-9981-7237ece545c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dc0168-7745-4479-b05c-18d757ca42df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Volume 7b6480f2-159f-4d5b-b876-495a92cca55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6480f2-159f-4d5b-b876-495a92cca55c', 'volume_size': 2} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1650806965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6480f2-159f-4d5b-b876-495a92cca55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fb2dd9d2d14ccc98a167856fcae8ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:22Z,use_quota=True,user_id='d31b4f4821b245ea90f803e97b6de7e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Creating volume 7b6480f2-159f-4d5b-b876-495a92cca55c {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:22 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c 2147483648 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c 2147483648 Sep 01 02:14:22 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c 2147483648" returned: 0 in 0.502s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=102,cinder:UPDATE=145,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=113,cinder:INSERT=31,cinder:UPDATE=115,cinder:DELETE=11 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c Sep 01 02:14:22 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87dc0168-7745-4479-b05c-18d757ca42df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6480f2-159f-4d5b-b876-495a92cca55c', 'volume_size': 2}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8230c00-d9ac-4ac7-9192-29719ad7aad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Volume volume-7b6480f2-159f-4d5b-b876-495a92cca55c (7b6480f2-159f-4d5b-b876-495a92cca55c): created successfully Sep 01 02:14:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8230c00-d9ac-4ac7-9192-29719ad7aad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Flow 'volume_create_manager' (f50a54b9-8196-4056-880d-bcf015558a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-de69372c-3b5c-4c9d-a2fa-6160f3cb6b16 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Created volume successfully. Sep 01 02:14:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Creating offline snapshot 4ff42652-0738-44a5-ae65-b41c39f449d0 of volume 7b6480f2-159f-4d5b-b876-495a92cca55c {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd898c5-c6ce-479c-a35d-e1052f95be83]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:24 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c Sep 01 02:14:24 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:24 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c" returned: 0 in 0.445s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 2G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 2G Sep 01 02:14:25 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 2G" returned: 0 in 0.512s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6480f2-159f-4d5b-b876-495a92cca55c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6480f2-159f-4d5b-b876-495a92cca55c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 Sep 01 02:14:25 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:25 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6480f2-159f-4d5b-b876-495a92cca55c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0" returned: 0 in 0.344s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:25 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 is being set with open permissions: ugo+rw Sep 01 02:14:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:25 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 Sep 01 02:14:25 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0" returned: 0 in 0.267s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:26 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.info Sep 01 02:14:26 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.info" returned: 0 in 0.290s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.info is being set with open permissions: ugo+rw Sep 01 02:14:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:26 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.info Sep 01 02:14:26 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:26 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.info" returned: 0 in 0.276s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-2b97487f-0013-42ee-ad36-d7d26a73b262 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Create snapshot completed successfully Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "cinder-4ff42652-0738-44a5-ae65-b41c39f449d0-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-4ff42652-0738-44a5-ae65-b41c39f449d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "cinder-quobyte-7b6480f2-159f-4d5b-b876-495a92cca55c" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-quobyte-7b6480f2-159f-4d5b-b876-495a92cca55c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "cinder-quobyte-4ff42652-0738-44a5-ae65-b41c39f449d0" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-quobyte-4ff42652-0738-44a5-ae65-b41c39f449d0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Deleting offline snapshot 4ff42652-0738-44a5-ae65-b41c39f449d0 of volume 7b6480f2-159f-4d5b-b876-495a92cca55c {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] snapshot_file for this snap is: volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be03de0-c8cb-48a6-880b-f34c4c76260d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:27 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 Sep 01 02:14:27 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:28 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0" returned: 0 in 0.428s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b6480f2-159f-4d5b-b876-495a92cca55c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b633c5-58ed-472b-9c2a-a6c700465fb2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:28 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c Sep 01 02:14:28 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:28 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c" returned: 0 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:28 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 Sep 01 02:14:28 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:29 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0" returned: 0 in 0.375s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:29 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0 Sep 01 02:14:29 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:29 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c.4ff42652-0738-44a5-ae65-b41c39f449d0" returned: 0 in 0.268s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-quobyte-4ff42652-0738-44a5-ae65-b41c39f449d0" released by "_delete_snapshot" :: held 1.620s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-quobyte-7b6480f2-159f-4d5b-b876-495a92cca55c" released by "delete_snapshot" :: held 1.646s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:29 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Created reservations ['6f8a96e8-c874-4899-9a7a-7d3bc57f8476', '055e22c9-37a1-40ff-ab7c-4453a8997c2d', 'd58d1717-54f4-4080-a7a7-f543da886da8', '6790a22a-9036-4dd5-9d01-1b45aa5fff93'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Delete snapshot completed successfully. Sep 01 02:14:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ac94798b-9437-42c6-8ff7-6acdd5004ae9 tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-4ff42652-0738-44a5-ae65-b41c39f449d0-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "cinder-7b6480f2-159f-4d5b-b876-495a92cca55c-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-7b6480f2-159f-4d5b-b876-495a92cca55c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "cinder-quobyte-7b6480f2-159f-4d5b-b876-495a92cca55c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-quobyte-7b6480f2-159f-4d5b-b876-495a92cca55c" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47c450b-6fab-4883-8c8c-8dd081d1d17f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:30 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c Sep 01 02:14:30 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:30 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c" returned: 0 in 0.386s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:30 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c Sep 01 02:14:30 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:30 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7b6480f2-159f-4d5b-b876-495a92cca55c" returned: 0 in 0.298s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-quobyte-7b6480f2-159f-4d5b-b876-495a92cca55c" released by "delete_volume" :: held 0.760s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:30 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Created reservations ['5f12b0e4-a112-4708-9106-94276ea306e4', '8034a917-ebdd-40e3-b59b-f21f1e3ecf3d', 'a0ff26c2-6b92-4e68-8528-c2f0064d2802', '747cc093-46df-4cb3-bc34-3922fcd0a887'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:31 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:14:31 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:31 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.324s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Deleted volume successfully. Sep 01 02:14:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e1c45e05-5468-4226-a9c0-efce33c3ff1d tempest-VolumesSnapshotNegativeTestJSON-536193765 None] Lock "cinder-7b6480f2-159f-4d5b-b876-495a92cca55c-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:41 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:41 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=17,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Flow 'volume_create_manager' (79cd7091-1cf9-44f4-a62f-8a4d03138ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071b05ed-3ae6-43cd-bd87-51e3fe08dc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071b05ed-3ae6-43cd-bd87-51e3fe08dc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1871631788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13887949-3f1e-4913-9da2-a5b20961cc29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca869efaa1dc47bb83e5bd08b0a19a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:00Z,use_quota=True,user_id='39246a5ddd8a4befa6770b567087b93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f45f5f-4b94-4362-9e7c-66f9690563a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f45f5f-4b94-4362-9e7c-66f9690563a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eca49b9-9b57-40cb-8f63-32e74b216da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eca49b9-9b57-40cb-8f63-32e74b216da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13887949-3f1e-4913-9da2-a5b20961cc29', 'volume_name': 'volume-13887949-3f1e-4913-9da2-a5b20961cc29', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900d5a7b-66c5-4f04-a459-8de5b3a21588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900d5a7b-66c5-4f04-a459-8de5b3a21588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a4d989-e5a7-4dd5-b966-d160c0eee7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Volume 13887949-3f1e-4913-9da2-a5b20961cc29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13887949-3f1e-4913-9da2-a5b20961cc29', 'volume_size': 1} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1871631788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13887949-3f1e-4913-9da2-a5b20961cc29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca869efaa1dc47bb83e5bd08b0a19a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:00Z,use_quota=True,user_id='39246a5ddd8a4befa6770b567087b93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Creating volume 13887949-3f1e-4913-9da2-a5b20961cc29 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:00 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:00 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 1073741824 Sep 01 02:15:00 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:00 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 1073741824" returned: 0 in 0.534s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:00 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 Sep 01 02:15:00 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:00 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29" returned: 0 in 0.284s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a4d989-e5a7-4dd5-b966-d160c0eee7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13887949-3f1e-4913-9da2-a5b20961cc29', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dc0366-3055-4fd7-8978-9ea25da00fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:01 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Volume volume-13887949-3f1e-4913-9da2-a5b20961cc29 (13887949-3f1e-4913-9da2-a5b20961cc29): created successfully Sep 01 02:15:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dc0366-3055-4fd7-8978-9ea25da00fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Flow 'volume_create_manager' (79cd7091-1cf9-44f4-a62f-8a4d03138ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:01 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3bcd55a8-1d8d-43e5-b88b-c4b594ddc498 tempest-AttachVolumeNegativeTest-1604580437 None] Created volume successfully. Sep 01 02:15:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-dc7402dd-6c4f-41d9-b5a4-b7b2156e6c69 req-c7fa006a-0aba-4a40-ac20-6881640674b6 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-dc7402dd-6c4f-41d9-b5a4-b7b2156e6c69 req-c7fa006a-0aba-4a40-ac20-6881640674b6 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-dc7402dd-6c4f-41d9-b5a4-b7b2156e6c69 req-c7fa006a-0aba-4a40-ac20-6881640674b6 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-dc7402dd-6c4f-41d9-b5a4-b7b2156e6c69 req-c7fa006a-0aba-4a40-ac20-6881640674b6 tempest-AttachVolumeNegativeTest-1604580437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-13887949-3f1e-4913-9da2-a5b20961cc29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '162d7d98-960f-4f38-9bac-4f8ecd153719', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:15:03 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-dc7402dd-6c4f-41d9-b5a4-b7b2156e6c69 req-c7fa006a-0aba-4a40-ac20-6881640674b6 tempest-AttachVolumeNegativeTest-1604580437 None] attachment_update completed successfully. Sep 01 02:15:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-7b653690-efd7-4806-9b40-1a421ac23dc2 req-a63cdce6-07cf-40fc-9437-c1d1a2ed1e89 tempest-AttachVolumeNegativeTest-1604580437 None] Terminate volume connection completed successfully. Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-7b653690-efd7-4806-9b40-1a421ac23dc2 req-a63cdce6-07cf-40fc-9437-c1d1a2ed1e89 tempest-AttachVolumeNegativeTest-1604580437 None] Deleting attachment 162d7d98-960f-4f38-9bac-4f8ecd153719. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:06 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:15:06 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:06 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.351s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:15:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:15:16 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:16 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Flow 'volume_create_manager' (068063f6-3640-4312-b97f-f6182bc3ed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc95a37d-21c2-4202-9f70-5b351925d9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc95a37d-21c2-4202-9f70-5b351925d9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-902469517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f79003a-e6ee-42b6-9435-45ae92a69e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda67957325b46c59f013996c901214c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:30Z,use_quota=True,user_id='d8b230ed5b96434fa4d4b0e5148ce4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf6519f-b6b8-45d3-ad62-6dc912e1f9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf6519f-b6b8-45d3-ad62-6dc912e1f9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e5e612-0c70-43ea-a901-fcb69f5a6e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e5e612-0c70-43ea-a901-fcb69f5a6e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f79003a-e6ee-42b6-9435-45ae92a69e99', 'volume_name': 'volume-5f79003a-e6ee-42b6-9435-45ae92a69e99', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d139b3-b5e2-4f1e-a653-789895d929e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d139b3-b5e2-4f1e-a653-789895d929e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d6a5d5-2757-491b-a73f-f0602d7154c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:30 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Volume 5f79003a-e6ee-42b6-9435-45ae92a69e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f79003a-e6ee-42b6-9435-45ae92a69e99', 'volume_size': 1} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-902469517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f79003a-e6ee-42b6-9435-45ae92a69e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda67957325b46c59f013996c901214c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:30Z,use_quota=True,user_id='d8b230ed5b96434fa4d4b0e5148ce4f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Creating volume 5f79003a-e6ee-42b6-9435-45ae92a69e99 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:30 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:30 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 1073741824 Sep 01 02:15:30 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:30 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 1073741824" returned: 0 in 0.514s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:30 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 Sep 01 02:15:30 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:31 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99" returned: 0 in 0.299s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d6a5d5-2757-491b-a73f-f0602d7154c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f79003a-e6ee-42b6-9435-45ae92a69e99', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d13acc-b02a-44ec-b573-972e2858d36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:31 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Volume volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 (5f79003a-e6ee-42b6-9435-45ae92a69e99): created successfully Sep 01 02:15:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d13acc-b02a-44ec-b573-972e2858d36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Flow 'volume_create_manager' (068063f6-3640-4312-b97f-f6182bc3ed1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-15858813-eafd-4d81-bba9-ac95d8388d5a tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Created volume successfully. Sep 01 02:15:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-2df4cceb-4266-4d1e-ac6a-4bfdad99b6bd req-6f52071b-5f26-49a0-93d8-9db94121e856 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-2df4cceb-4266-4d1e-ac6a-4bfdad99b6bd req-6f52071b-5f26-49a0-93d8-9db94121e856 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-2df4cceb-4266-4d1e-ac6a-4bfdad99b6bd req-6f52071b-5f26-49a0-93d8-9db94121e856 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-2df4cceb-4266-4d1e-ac6a-4bfdad99b6bd req-6f52071b-5f26-49a0-93d8-9db94121e856 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-5f79003a-e6ee-42b6-9435-45ae92a69e99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd7a2f25-fd9d-4d2a-9819-a84b4826fba5', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:15:33 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-2df4cceb-4266-4d1e-ac6a-4bfdad99b6bd req-6f52071b-5f26-49a0-93d8-9db94121e856 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] attachment_update completed successfully. Sep 01 02:15:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-2381184c-3282-4125-98b6-dbee50ded3db req-fb49f154-6751-4f4e-92f2-0a7f7fefc930 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Terminate volume connection completed successfully. Sep 01 02:15:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-2381184c-3282-4125-98b6-dbee50ded3db req-fb49f154-6751-4f4e-92f2-0a7f7fefc930 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Deleting attachment dd7a2f25-fd9d-4d2a-9819-a84b4826fba5. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:15:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Acquiring lock "cinder-5f79003a-e6ee-42b6-9435-45ae92a69e99-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "cinder-5f79003a-e6ee-42b6-9435-45ae92a69e99-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Acquiring lock "cinder-quobyte-5f79003a-e6ee-42b6-9435-45ae92a69e99" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "cinder-quobyte-5f79003a-e6ee-42b6-9435-45ae92a69e99" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:36 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e9144d-804d-4a66-90ad-89192ef9c563]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:36 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 Sep 01 02:15:36 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:36 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:36 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99 Sep 01 02:15:36 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:37 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5f79003a-e6ee-42b6-9435-45ae92a69e99" returned: 0 in 0.279s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "cinder-quobyte-5f79003a-e6ee-42b6-9435-45ae92a69e99" released by "delete_volume" :: held 0.707s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Created reservations ['f1d415de-0dda-4900-adf6-790e28c4a6c8', '4fc27e1c-cb34-44ed-a22b-2fc903010ccc', '64972f56-53b3-4b28-82da-a8fe7be8976f', '69d64f5e-5706-4529-84b9-2d2494742560'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:37 devstack sudo[100786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:15:37 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:37 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.250s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Deleted volume successfully. Sep 01 02:15:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-50afba6f-178e-4799-8b73-f588eb666a17 tempest-TestServerVolumeAttachScenarioOldVersion-1458760234 None] Lock "cinder-5f79003a-e6ee-42b6-9435-45ae92a69e99-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Flow 'volume_create_manager' (846f3c73-20bb-417c-b059-d4f02dfa3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58872515-ac19-4c7a-acc8-10f60eca11f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58872515-ac19-4c7a-acc8-10f60eca11f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-951816265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5065af6b-85fa-4acc-a88b-f3002055f63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca869efaa1dc47bb83e5bd08b0a19a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:43Z,use_quota=True,user_id='39246a5ddd8a4befa6770b567087b93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c56b34-dd78-4bfc-b19c-78cac3a3e5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c56b34-dd78-4bfc-b19c-78cac3a3e5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d9cc4e-c76d-4c62-a3a6-09044a08dcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d9cc4e-c76d-4c62-a3a6-09044a08dcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5065af6b-85fa-4acc-a88b-f3002055f63b', 'volume_name': 'volume-5065af6b-85fa-4acc-a88b-f3002055f63b', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085fd646-04e4-44ce-9206-8f2c739ce0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (085fd646-04e4-44ce-9206-8f2c739ce0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ed874a-3607-44f7-bb4e-60749969f118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:42 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Volume 5065af6b-85fa-4acc-a88b-f3002055f63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5065af6b-85fa-4acc-a88b-f3002055f63b', 'volume_size': 1} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-951816265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5065af6b-85fa-4acc-a88b-f3002055f63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca869efaa1dc47bb83e5bd08b0a19a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:43Z,use_quota=True,user_id='39246a5ddd8a4befa6770b567087b93f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Creating volume 5065af6b-85fa-4acc-a88b-f3002055f63b {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:42 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:15:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:43 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b 1073741824 Sep 01 02:15:43 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:43 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b 1073741824" returned: 0 in 0.514s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:43 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b Sep 01 02:15:43 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:43 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b" returned: 0 in 0.283s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ed874a-3607-44f7-bb4e-60749969f118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5065af6b-85fa-4acc-a88b-f3002055f63b', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6899b6df-0736-438c-a904-e4bfb8ac0a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:43 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Volume volume-5065af6b-85fa-4acc-a88b-f3002055f63b (5065af6b-85fa-4acc-a88b-f3002055f63b): created successfully Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6899b6df-0736-438c-a904-e4bfb8ac0a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Flow 'volume_create_manager' (846f3c73-20bb-417c-b059-d4f02dfa3bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9de7b5b8-f926-423c-9935-3f5ad88a036f tempest-AttachVolumeNegativeTest-1604580437 None] Created volume successfully. Sep 01 02:15:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-f6a0dc2d-3133-4e8b-96ad-61f9ba4fdd75 req-f6958724-42cb-4837-a6cd-5e564a6d0b37 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-f6a0dc2d-3133-4e8b-96ad-61f9ba4fdd75 req-f6958724-42cb-4837-a6cd-5e564a6d0b37 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-f6a0dc2d-3133-4e8b-96ad-61f9ba4fdd75 req-f6958724-42cb-4837-a6cd-5e564a6d0b37 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-f6a0dc2d-3133-4e8b-96ad-61f9ba4fdd75 req-f6958724-42cb-4837-a6cd-5e564a6d0b37 tempest-AttachVolumeNegativeTest-1604580437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-5065af6b-85fa-4acc-a88b-f3002055f63b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b24286e0-83d8-446c-9f0a-79227423851a', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:15:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-f6a0dc2d-3133-4e8b-96ad-61f9ba4fdd75 req-f6958724-42cb-4837-a6cd-5e564a6d0b37 tempest-AttachVolumeNegativeTest-1604580437 None] attachment_update completed successfully. Sep 01 02:15:48 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-d2d40335-3294-4218-be54-c856a2d70603 req-20dc4c4b-cc85-4c14-a443-9e511553f08b tempest-AttachVolumeNegativeTest-1604580437 None] Terminate volume connection completed successfully. Sep 01 02:15:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-d2d40335-3294-4218-be54-c856a2d70603 req-20dc4c4b-cc85-4c14-a443-9e511553f08b tempest-AttachVolumeNegativeTest-1604580437 None] Deleting attachment b24286e0-83d8-446c-9f0a-79227423851a. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:15:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "cinder-5065af6b-85fa-4acc-a88b-f3002055f63b-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-5065af6b-85fa-4acc-a88b-f3002055f63b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "cinder-quobyte-5065af6b-85fa-4acc-a88b-f3002055f63b" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-quobyte-5065af6b-85fa-4acc-a88b-f3002055f63b" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:55 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cb212c-7dff-4765-93cc-d6b9c0e6025d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:55 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b Sep 01 02:15:55 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:55 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b" returned: 0 in 0.416s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:56 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b Sep 01 02:15:56 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:56 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5065af6b-85fa-4acc-a88b-f3002055f63b" returned: 0 in 0.293s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-quobyte-5065af6b-85fa-4acc-a88b-f3002055f63b" released by "delete_volume" :: held 0.777s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Created reservations ['2a75909b-1a3c-4a5c-85d4-5c60813de37d', '951ee73b-2b52-4dd1-ad52-27fe0322b527', '50376dc2-bd30-4523-b6bd-dac928dfd905', 'ed663166-2173-4081-895a-1edea946490b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:56 devstack sudo[101325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:15:56 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "cinder-13887949-3f1e-4913-9da2-a5b20961cc29-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:56 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.335s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Deleted volume successfully. Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-13887949-3f1e-4913-9da2-a5b20961cc29-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-03b8eebf-03ac-4a88-8827-9b74d412f740 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-5065af6b-85fa-4acc-a88b-f3002055f63b-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "cinder-quobyte-13887949-3f1e-4913-9da2-a5b20961cc29" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-quobyte-13887949-3f1e-4913-9da2-a5b20961cc29" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b4eb77-810b-4389-a076-7feb807e9db6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:57 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 Sep 01 02:15:57 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:57 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:57 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29 Sep 01 02:15:57 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:57 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-13887949-3f1e-4913-9da2-a5b20961cc29" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-quobyte-13887949-3f1e-4913-9da2-a5b20961cc29" released by "delete_volume" :: held 0.693s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Created reservations ['2b04370c-bbf1-4a51-a010-cd953aca0bde', '001a1eaf-feb3-4209-9af0-e1fe2919bd8f', '1074d317-5142-4155-82a8-892712d8d4a3', 'd659c2e8-eb2e-4391-b5cc-d61d01efd866'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:57 devstack sudo[101336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:15:57 devstack sudo[101336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:58 devstack sudo[101336]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.319s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:58 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Deleted volume successfully. Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a1015a00-1fb5-403a-82e2-9084f05d92fb tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-13887949-3f1e-4913-9da2-a5b20961cc29-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "cinder-6f1a0d52-765f-4885-b03a-cbd1677aa6ae-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-6f1a0d52-765f-4885-b03a-cbd1677aa6ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "cinder-quobyte-6f1a0d52-765f-4885-b03a-cbd1677aa6ae" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-quobyte-6f1a0d52-765f-4885-b03a-cbd1677aa6ae" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fbb0b8-d2f8-4774-8587-70bd0fa28c54]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:58 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae Sep 01 02:15:58 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:58 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae" returned: 0 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:58 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae Sep 01 02:15:58 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:58 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6f1a0d52-765f-4885-b03a-cbd1677aa6ae" returned: 0 in 0.267s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-quobyte-6f1a0d52-765f-4885-b03a-cbd1677aa6ae" released by "delete_volume" :: held 0.701s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Created reservations ['6b192a56-26e8-42ea-99c9-2665bab04018', '01311a01-b300-4e41-89b6-0064e58016d8', '57a60856-300d-4b33-9ca3-7f5432ded980', '82a1b00f-6898-420a-a213-54564a750f04'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:59 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:15:59 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:59 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.310s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Deleted volume successfully. Sep 01 02:15:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-53e18fdf-3ae0-471f-8fd9-9dfbff9cb344 tempest-AttachVolumeNegativeTest-1604580437 None] Lock "cinder-6f1a0d52-765f-4885-b03a-cbd1677aa6ae-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:06 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:16:06 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:06 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.342s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:16:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:16:09 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=42,cinder:SELECT=34,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:09 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=45,cinder:UPDATE=41,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Flow 'volume_create_manager' (532eda91-a865-4877-b80e-94d3ef7a3b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef3580e-21d0-4cb9-8af1-0a953a59625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef3580e-21d0-4cb9-8af1-0a953a59625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1460332778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542c8314-b310-484d-9b3a-ea2de237026d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddd128fd1a19489a83898e407346c460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:11Z,use_quota=True,user_id='ec0ad0d8ca9f41efa8d9d03524458339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249fdb79-57dc-4a6c-8fc4-b02f96f2afed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249fdb79-57dc-4a6c-8fc4-b02f96f2afed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a751ba86-787d-490c-ae67-c791568bf10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a751ba86-787d-490c-ae67-c791568bf10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542c8314-b310-484d-9b3a-ea2de237026d', 'volume_name': 'volume-542c8314-b310-484d-9b3a-ea2de237026d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02be870f-5efe-49a3-be32-12b575efd8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02be870f-5efe-49a3-be32-12b575efd8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11fdaaf-39f5-42dc-825a-085eb9279de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:11 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Volume 542c8314-b310-484d-9b3a-ea2de237026d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542c8314-b310-484d-9b3a-ea2de237026d', 'volume_size': 1} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1460332778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542c8314-b310-484d-9b3a-ea2de237026d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ddd128fd1a19489a83898e407346c460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:11Z,use_quota=True,user_id='ec0ad0d8ca9f41efa8d9d03524458339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Creating volume 542c8314-b310-484d-9b3a-ea2de237026d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:11 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:11 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d 1073741824 Sep 01 02:16:11 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:11 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d 1073741824" returned: 0 in 0.471s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:11 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d Sep 01 02:16:11 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:12 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11fdaaf-39f5-42dc-825a-085eb9279de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542c8314-b310-484d-9b3a-ea2de237026d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f73b10-0a69-4bb7-8883-f98f1fb9157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:12 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Volume volume-542c8314-b310-484d-9b3a-ea2de237026d (542c8314-b310-484d-9b3a-ea2de237026d): created successfully Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f73b10-0a69-4bb7-8883-f98f1fb9157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Flow 'volume_create_manager' (532eda91-a865-4877-b80e-94d3ef7a3b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:12 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-464ac068-d0f5-4c9f-8ba7-a8e3f172f269 req-1d0cc94c-c198-4b50-8c50-bde84adc5cf9 tempest-VolumesGetTestJSON-1481684900 None] Created volume successfully. Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Acquiring lock "cinder-542c8314-b310-484d-9b3a-ea2de237026d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Lock "cinder-542c8314-b310-484d-9b3a-ea2de237026d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Acquiring lock "cinder-quobyte-542c8314-b310-484d-9b3a-ea2de237026d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Lock "cinder-quobyte-542c8314-b310-484d-9b3a-ea2de237026d" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[342f4cf2-6642-40ae-81c3-5e3508c532ad]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:13 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d Sep 01 02:16:13 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:13 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:13 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d Sep 01 02:16:13 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:13 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-542c8314-b310-484d-9b3a-ea2de237026d" returned: 0 in 0.273s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Lock "cinder-quobyte-542c8314-b310-484d-9b3a-ea2de237026d" released by "delete_volume" :: held 0.702s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG cinder.quota [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Created reservations ['cdc97e27-67f9-4c0e-b12f-dd7ac5d35f00', '636dee3a-6a25-4a27-91b9-1c1f87920877', '17963eea-2164-48b8-8108-f92ec0dfec30', 'f81a57d7-e2a1-494d-87ff-23cb8d497545'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:13 devstack sudo[101379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:16:13 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:14 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.263s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:14 devstack cinder-volume[87425]: DEBUG cinder.manager [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Deleted volume successfully. Sep 01 02:16:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25697d12-c01d-49dd-8572-e266fa230ac0 req-eb56c7a2-2366-4b28-a9f6-787d0f9ed490 tempest-VolumesGetTestJSON-1481684900 None] Lock "cinder-542c8314-b310-484d-9b3a-ea2de237026d-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Flow 'volume_create_manager' (fb460539-286d-4849-b1a9-2e0559688301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daffdb47-163b-4bdd-bc3d-c3d92ca499e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daffdb47-163b-4bdd-bc3d-c3d92ca499e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1667560635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf15fcf-38c5-4ee1-8974-78273a4e5e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428609d0fd5c4becb3adbeb6366de18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:21Z,use_quota=True,user_id='24e5c30d4c07444da1d4afec6e84356d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202395c2-9b46-4153-85c4-1d99a36b237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202395c2-9b46-4153-85c4-1d99a36b237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8724719c-ae8c-48c7-a26c-27fdff30ed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8724719c-ae8c-48c7-a26c-27fdff30ed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf15fcf-38c5-4ee1-8974-78273a4e5e19', 'volume_name': 'volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c7f608-1be6-4171-9d59-b616cfa46ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c7f608-1be6-4171-9d59-b616cfa46ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7f6fed-9c93-4b7b-9203-ee82e770e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Volume 0cf15fcf-38c5-4ee1-8974-78273a4e5e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19', 'volume_size': 1} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1667560635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf15fcf-38c5-4ee1-8974-78273a4e5e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428609d0fd5c4becb3adbeb6366de18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:21Z,use_quota=True,user_id='24e5c30d4c07444da1d4afec6e84356d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Creating volume 0cf15fcf-38c5-4ee1-8974-78273a4e5e19 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:20 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:16:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:21 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 1073741824 Sep 01 02:16:21 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Flow 'volume_create_manager' (97d0ad6d-8bf4-472f-95bc-b5bc05d57c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8619f499-7514-46e1-8a23-1ba75d8126a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8619f499-7514-46e1-8a23-1ba75d8126a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1101774585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d364bac4-39a7-4f1d-a524-3d895264674d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428609d0fd5c4becb3adbeb6366de18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:21Z,use_quota=True,user_id='24e5c30d4c07444da1d4afec6e84356d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c50c0b-fe16-4afc-80c0-7f599fe0485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c50c0b-fe16-4afc-80c0-7f599fe0485c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2459444-7ff9-4b9d-95c8-35dbcd596d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2459444-7ff9-4b9d-95c8-35dbcd596d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd364bac4-39a7-4f1d-a524-3d895264674d', 'volume_name': 'volume-d364bac4-39a7-4f1d-a524-3d895264674d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb95434e-faeb-4ed9-a98d-40076f885e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb95434e-faeb-4ed9-a98d-40076f885e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a253c6f-eac4-4680-ba49-f5194f985a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:21 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Volume d364bac4-39a7-4f1d-a524-3d895264674d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d364bac4-39a7-4f1d-a524-3d895264674d', 'volume_size': 1} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:21 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 1073741824" returned: 0 in 0.567s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:21 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 Sep 01 02:16:21 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:21 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19" returned: 0 in 0.326s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.498s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1101774585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d364bac4-39a7-4f1d-a524-3d895264674d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428609d0fd5c4becb3adbeb6366de18b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:21Z,use_quota=True,user_id='24e5c30d4c07444da1d4afec6e84356d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Creating volume d364bac4-39a7-4f1d-a524-3d895264674d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:21 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7f6fed-9c93-4b7b-9203-ee82e770e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d 1073741824 Sep 01 02:16:21 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7575d4-bac6-44a6-a36d-b11a9bc98744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:21 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Volume volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 (0cf15fcf-38c5-4ee1-8974-78273a4e5e19): created successfully Sep 01 02:16:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7575d4-bac6-44a6-a36d-b11a9bc98744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Flow 'volume_create_manager' (fb460539-286d-4849-b1a9-2e0559688301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4d0c2280-45a1-401c-8a72-b620a2ecef5f tempest-TestServerVolumeAttachmentScenario-653686193 None] Created volume successfully. Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4ff4453f-d000-48c0-8dbe-c00760c078ae tempest-BackendsCapabilitiesAdminTestsJSON-1951028594 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0264511108398, 'free_capacity_gb': 1774.0264511108398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87425) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0deacbd-574f-4947-acc2-0d82f9e7214d tempest-BackendsCapabilitiesAdminTestsJSON-1951028594 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0264511108398, 'free_capacity_gb': 1774.0264511108398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87425) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:16:22 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d 1073741824" returned: 0 in 0.607s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d Sep 01 02:16:22 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:22 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d" returned: 0 in 0.304s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a253c6f-eac4-4680-ba49-f5194f985a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d364bac4-39a7-4f1d-a524-3d895264674d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083f439c-563b-4d89-9db5-04a700668a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Volume volume-d364bac4-39a7-4f1d-a524-3d895264674d (d364bac4-39a7-4f1d-a524-3d895264674d): created successfully Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083f439c-563b-4d89-9db5-04a700668a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Flow 'volume_create_manager' (97d0ad6d-8bf4-472f-95bc-b5bc05d57c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cf925768-243d-4b91-9b22-047517911c15 tempest-TestServerVolumeAttachmentScenario-653686193 None] Created volume successfully. Sep 01 02:16:32 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:32 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=10,cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=4 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1c074618-45e2-4a9c-8e26-ee5d1b2dccd0 tempest-GroupsTest-1966905523 None] Group tempest-Group1-97341896: creating Sep 01 02:16:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1c074618-45e2-4a9c-8e26-ee5d1b2dccd0 tempest-GroupsTest-1966905523 None] Group tempest-Group1-97341896: created successfully Sep 01 02:16:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1c074618-45e2-4a9c-8e26-ee5d1b2dccd0 tempest-GroupsTest-1966905523 None] Create group completed successfully. Sep 01 02:16:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b6cd168e-6e97-491f-948c-0088f0662f56 tempest-GroupsTest-1966905523 None] Group tempest-Group2-1308762316: creating Sep 01 02:16:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b6cd168e-6e97-491f-948c-0088f0662f56 tempest-GroupsTest-1966905523 None] Group tempest-Group2-1308762316: created successfully Sep 01 02:16:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b6cd168e-6e97-491f-948c-0088f0662f56 tempest-GroupsTest-1966905523 None] Create group completed successfully. Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Flow 'volume_create_manager' (d5f9083b-4afa-4a49-9de5-477e4f372d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450452bf-6891-493d-a948-598d9cb43318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450452bf-6891-493d-a948-598d9cb43318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1246356960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbf2abc8-d276-494f-8184-b937c3d8d370,host='devstack@QuobyteHD#QuobyteHD',id=904433c2-df81-47c1-8843-72a02b12ce14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d57b412c5d942cb8095b9c8699bfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:38Z,use_quota=True,user_id='20e99037c1f9439090fb80fab9d93064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d15a4fa8-abc2-4432-8c96-f0273868c307),volume_type_id=d15a4fa8-abc2-4432-8c96-f0273868c307)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a7af3c-8582-41b2-8802-e0e3d6c071f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07a7af3c-8582-41b2-8802-e0e3d6c071f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c204489-c450-47f8-b855-d86d73d07117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c204489-c450-47f8-b855-d86d73d07117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904433c2-df81-47c1-8843-72a02b12ce14', 'volume_name': 'volume-904433c2-df81-47c1-8843-72a02b12ce14', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee68c11-13f4-4d45-9d82-7724fb8a4064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee68c11-13f4-4d45-9d82-7724fb8a4064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8174dcf0-3421-4304-8d70-12b56f9ef1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:38 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Volume 904433c2-df81-47c1-8843-72a02b12ce14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904433c2-df81-47c1-8843-72a02b12ce14', 'volume_size': 1} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbf2abc8-d276-494f-8184-b937c3d8d370,created_at=2026-09-01T00:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1246356960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbf2abc8-d276-494f-8184-b937c3d8d370,host='devstack@QuobyteHD#QuobyteHD',id=904433c2-df81-47c1-8843-72a02b12ce14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d57b412c5d942cb8095b9c8699bfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:38Z,use_quota=True,user_id='20e99037c1f9439090fb80fab9d93064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d15a4fa8-abc2-4432-8c96-f0273868c307),volume_type_id=d15a4fa8-abc2-4432-8c96-f0273868c307)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Creating volume 904433c2-df81-47c1-8843-72a02b12ce14 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:38 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:38 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 1073741824 Sep 01 02:16:38 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:38 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 1073741824" returned: 0 in 0.492s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:38 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 Sep 01 02:16:38 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:39 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14" returned: 0 in 0.273s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8174dcf0-3421-4304-8d70-12b56f9ef1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904433c2-df81-47c1-8843-72a02b12ce14', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331393d6-988d-4cfe-9bda-d3b483faf7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:39 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Volume volume-904433c2-df81-47c1-8843-72a02b12ce14 (904433c2-df81-47c1-8843-72a02b12ce14): created successfully Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331393d6-988d-4cfe-9bda-d3b483faf7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Flow 'volume_create_manager' (d5f9083b-4afa-4a49-9de5-477e4f372d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a1d0efb1-7d03-43c6-8774-80b5af6071dd tempest-GroupsTest-1966905523 None] Created volume successfully. Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Acquiring lock "cinder-quobyte-904433c2-df81-47c1-8843-72a02b12ce14" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Lock "cinder-quobyte-904433c2-df81-47c1-8843-72a02b12ce14" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cd57b5-096d-4756-9ecd-b26bd5303b4d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:40 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 Sep 01 02:16:40 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:40 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:40 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14 Sep 01 02:16:40 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:40 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-904433c2-df81-47c1-8843-72a02b12ce14" returned: 0 in 0.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Lock "cinder-quobyte-904433c2-df81-47c1-8843-72a02b12ce14" released by "delete_volume" :: held 0.729s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Created reservations ['bf3ab727-8622-46a0-94dc-b0a72efceb39'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:40 devstack cinder-volume[87425]: WARNING cinder.quota [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1798962989 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1798962989, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:16:40 devstack cinder-volume[87425]: WARNING cinder.quota [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1798962989 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1798962989, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Created reservations ['17550cd5-ff94-42a9-89dd-a2fcf666e861', 'b4137e9a-1951-49db-b4e1-78ec1929cae6', '459da956-0193-4695-bffe-d808d2f49389', '87e6c225-3cc9-47f1-9ab5-721dd5123a79'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:40 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:16:40 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:41 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.301s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:41 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d96e2354-8fa9-498c-8083-43bfa00d6738 tempest-GroupsTest-1966905523 None] Delete group completed successfully. Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Created reservations ['49bb8ec7-4c44-48c4-a2f0-2b2596265f79'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:41 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:16:41 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:41 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.277s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:41 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:41 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-20d2a274-2361-44e0-a5d2-ebc319b56348 tempest-GroupsTest-1966905523 None] Delete group completed successfully. Sep 01 02:16:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-596f5d16-68e8-43f7-a6e6-8de8a9f9f165 tempest-GroupsTest-1966905523 None] Group tempest-GroupsTest-Group-424495267: creating Sep 01 02:16:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-596f5d16-68e8-43f7-a6e6-8de8a9f9f165 tempest-GroupsTest-1966905523 None] Group tempest-GroupsTest-Group-424495267: created successfully Sep 01 02:16:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-596f5d16-68e8-43f7-a6e6-8de8a9f9f165 tempest-GroupsTest-1966905523 None] Create group completed successfully. Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Flow 'volume_create_manager' (c55bed00-ee85-4f4f-8795-8348920fabc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b010465-05c0-4454-975f-282fa49f8c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b010465-05c0-4454-975f-282fa49f8c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1142105536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b984c2e8-4ba4-48f7-b3bd-279725c82f48,host='devstack@QuobyteHD#QuobyteHD',id=9b1a6515-32e2-4ddd-a98d-dfeb3511f488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d57b412c5d942cb8095b9c8699bfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:45Z,use_quota=True,user_id='20e99037c1f9439090fb80fab9d93064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7d562f8-8e63-478e-8c62-f52f60e18a6f),volume_type_id=f7d562f8-8e63-478e-8c62-f52f60e18a6f)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae859b8-b7aa-42ed-b4ed-53c53891ee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae859b8-b7aa-42ed-b4ed-53c53891ee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f719b3-161d-407b-92c1-974b44ff430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f719b3-161d-407b-92c1-974b44ff430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b1a6515-32e2-4ddd-a98d-dfeb3511f488', 'volume_name': 'volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adc3b8c-e77d-4350-94e4-c1ad5dea7fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1adc3b8c-e77d-4350-94e4-c1ad5dea7fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103b2341-fa99-49ed-8984-354d41b8b10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Volume 9b1a6515-32e2-4ddd-a98d-dfeb3511f488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488', 'volume_size': 1} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b984c2e8-4ba4-48f7-b3bd-279725c82f48,created_at=2026-09-01T00:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1142105536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b984c2e8-4ba4-48f7-b3bd-279725c82f48,host='devstack@QuobyteHD#QuobyteHD',id=9b1a6515-32e2-4ddd-a98d-dfeb3511f488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d57b412c5d942cb8095b9c8699bfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:45Z,use_quota=True,user_id='20e99037c1f9439090fb80fab9d93064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7d562f8-8e63-478e-8c62-f52f60e18a6f),volume_type_id=f7d562f8-8e63-478e-8c62-f52f60e18a6f)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Creating volume 9b1a6515-32e2-4ddd-a98d-dfeb3511f488 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:44 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:16:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:44 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 1073741824 Sep 01 02:16:44 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:45 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 1073741824" returned: 0 in 0.438s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:45 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 Sep 01 02:16:45 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:45 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488" returned: 0 in 0.260s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103b2341-fa99-49ed-8984-354d41b8b10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bc1436-e946-4acd-8b8c-5fb815440ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:45 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Volume volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 (9b1a6515-32e2-4ddd-a98d-dfeb3511f488): created successfully Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bc1436-e946-4acd-8b8c-5fb815440ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Flow 'volume_create_manager' (c55bed00-ee85-4f4f-8795-8348920fabc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f044e53c-ee81-40b1-b8fd-791a298a4a2a tempest-GroupsTest-1966905523 None] Created volume successfully. Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Flow 'volume_create_manager' (cac4d7fc-cd29-4985-935d-22ca3a906657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db343555-f2b9-44fa-816b-c8403e8ca2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db343555-f2b9-44fa-816b-c8403e8ca2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2054867244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b984c2e8-4ba4-48f7-b3bd-279725c82f48,host='devstack@QuobyteHD#QuobyteHD',id=8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d57b412c5d942cb8095b9c8699bfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:46Z,use_quota=True,user_id='20e99037c1f9439090fb80fab9d93064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7d562f8-8e63-478e-8c62-f52f60e18a6f),volume_type_id=f7d562f8-8e63-478e-8c62-f52f60e18a6f)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcb4987-426f-4c12-91ba-f62cbccf1904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcb4987-426f-4c12-91ba-f62cbccf1904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb013a2-4063-4e0c-8c96-536f167fec06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb013a2-4063-4e0c-8c96-536f167fec06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8', 'volume_name': 'volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a27e216-5aa4-40d6-9742-5e2ec26ef13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a27e216-5aa4-40d6-9742-5e2ec26ef13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a2bdfc-3dae-47a8-afea-fd4c8f8afc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:46 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Volume 8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8', 'volume_size': 1} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b984c2e8-4ba4-48f7-b3bd-279725c82f48,created_at=2026-09-01T00:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2054867244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b984c2e8-4ba4-48f7-b3bd-279725c82f48,host='devstack@QuobyteHD#QuobyteHD',id=8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d57b412c5d942cb8095b9c8699bfacd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:46Z,use_quota=True,user_id='20e99037c1f9439090fb80fab9d93064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7d562f8-8e63-478e-8c62-f52f60e18a6f),volume_type_id=f7d562f8-8e63-478e-8c62-f52f60e18a6f)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Creating volume 8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:46 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:46 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 1073741824 Sep 01 02:16:46 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:46 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 1073741824" returned: 0 in 0.414s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:47 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 Sep 01 02:16:47 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:47 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8" returned: 0 in 0.276s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:47 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a2bdfc-3dae-47a8-afea-fd4c8f8afc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:47 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a601d-2ec6-4275-b4b6-6a2a504312c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:47 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Volume volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 (8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8): created successfully Sep 01 02:16:47 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3a601d-2ec6-4275-b4b6-6a2a504312c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:47 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Flow 'volume_create_manager' (cac4d7fc-cd29-4985-935d-22ca3a906657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9590c1fd-8e6a-470f-9a5f-f384c4aa185b tempest-GroupsTest-1966905523 None] Created volume successfully. Sep 01 02:16:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e444f91f-9c91-48fc-a89e-e1f0699a8e88 tempest-GroupsTest-1966905523 None] Update group completed successfully. Sep 01 02:16:49 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8144a0a6-b356-4859-ad40-3e4c10684230 tempest-GroupsTest-1966905523 None] Update group completed successfully. Sep 01 02:16:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Acquiring lock "cinder-quobyte-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Lock "cinder-quobyte-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[016f7992-5fcd-4155-a2d2-05d51345d8f2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 Sep 01 02:16:51 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:51 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8" returned: 0 in 0.389s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8 Sep 01 02:16:51 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:51 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8" returned: 0 in 0.267s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Lock "cinder-quobyte-8bc2bbdb-6ed6-4ec0-8c5a-66ce277529e8" released by "delete_volume" :: held 0.706s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Acquiring lock "cinder-quobyte-9b1a6515-32e2-4ddd-a98d-dfeb3511f488" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Lock "cinder-quobyte-9b1a6515-32e2-4ddd-a98d-dfeb3511f488" acquired by "delete_volume" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d8857d-ce9e-4b9c-bd23-f978528e7e23]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 Sep 01 02:16:51 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:51 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488" returned: 0 in 0.358s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488 Sep 01 02:16:51 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:52 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b1a6515-32e2-4ddd-a98d-dfeb3511f488" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Lock "cinder-quobyte-9b1a6515-32e2-4ddd-a98d-dfeb3511f488" released by "delete_volume" :: held 0.655s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Created reservations ['82cfe0e0-19c2-494b-82d2-f3be6affe67d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:52 devstack cinder-volume[87425]: WARNING cinder.quota [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-288524394 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-288524394, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:16:52 devstack cinder-volume[87425]: WARNING cinder.quota [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-288524394 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-288524394, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Created reservations ['ce469637-a1c2-4391-86c1-a5f6b56591c0', 'a0277214-9cf6-4643-99ff-c9256c0232d0', 'a45f125b-a1ca-4f7b-8f3b-bb875cda8e29', '3ad6b8ec-7d4a-4c68-a83d-68055481d39d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Created reservations ['89d10085-27b4-4068-ad7b-e9e985e005f8', '7b016755-c54f-46e3-a6e9-d19a08ea86c4', 'c4fbc511-3afb-4ff1-94fb-32867ec29978', 'f23e6967-79a2-46ff-9984-6f63d7c538ac'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:52 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:16:52 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:52 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.301s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:52 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b27f4001-13b6-4f89-92dd-fa7a29a2e0b2 tempest-GroupsTest-1966905523 None] Delete group completed successfully. Sep 01 02:16:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-e99cd609-569b-456a-b374-35c4fdefbce8 req-46eaa5aa-d596-407c-a3e7-f74c6b7a5534 tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-e99cd609-569b-456a-b374-35c4fdefbce8 req-46eaa5aa-d596-407c-a3e7-f74c6b7a5534 tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-e99cd609-569b-456a-b374-35c4fdefbce8 req-46eaa5aa-d596-407c-a3e7-f74c6b7a5534 tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-e99cd609-569b-456a-b374-35c4fdefbce8 req-46eaa5aa-d596-407c-a3e7-f74c6b7a5534 tempest-TestServerVolumeAttachmentScenario-653686193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'de629e94-44bc-4171-b4c1-b13e4721e6a7', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:16:54 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-e99cd609-569b-456a-b374-35c4fdefbce8 req-46eaa5aa-d596-407c-a3e7-f74c6b7a5534 tempest-TestServerVolumeAttachmentScenario-653686193 None] attachment_update completed successfully. Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Flow 'volume_create_manager' (13ea6fc6-f438-4838-ad40-e6f77a29c040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a2c8bd-51c0-4d02-9ac9-0422b1ba700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6a2c8bd-51c0-4d02-9ac9-0422b1ba700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-452304273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea88e2dea44e269d79266a7d88c4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:59Z,use_quota=True,user_id='01072f8c4da54635af223298fe4d95e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783c0cd6-c53f-4aee-8b31-3ee2ebd44c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783c0cd6-c53f-4aee-8b31-3ee2ebd44c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b528db0-2ac9-4814-9688-9787e231a500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b528db0-2ac9-4814-9688-9787e231a500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb', 'volume_name': 'volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e968bef0-802b-46b4-8641-735bdf9a827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e968bef0-802b-46b4-8641-735bdf9a827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32a36f6-3c3e-41f0-a0d4-540e80f114cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb', 'volume_size': 1} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-452304273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eea88e2dea44e269d79266a7d88c4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:59Z,use_quota=True,user_id='01072f8c4da54635af223298fe4d95e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Creating volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:59 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:59 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb 1073741824 Sep 01 02:16:59 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:59 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb 1073741824" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:59 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb Sep 01 02:16:59 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:00 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" returned: 0 in 0.305s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32a36f6-3c3e-41f0-a0d4-540e80f114cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a93565d-b3f3-449b-b741-871e95978c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:00 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Volume volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb (afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb): created successfully Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a93565d-b3f3-449b-b741-871e95978c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Flow 'volume_create_manager' (13ea6fc6-f438-4838-ad40-e6f77a29c040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-229c1d8e-686e-4381-a585-fc52cd2267ce tempest-SnapshotsActionsTest-988590588 None] Created volume successfully. Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-daf5cf53-cc3b-4f17-88f8-84f72720acf3 req-dcd11519-77ba-482e-b68f-4f2a03c3f1cd tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-daf5cf53-cc3b-4f17-88f8-84f72720acf3 req-dcd11519-77ba-482e-b68f-4f2a03c3f1cd tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-daf5cf53-cc3b-4f17-88f8-84f72720acf3 req-dcd11519-77ba-482e-b68f-4f2a03c3f1cd tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-daf5cf53-cc3b-4f17-88f8-84f72720acf3 req-dcd11519-77ba-482e-b68f-4f2a03c3f1cd tempest-TestServerVolumeAttachmentScenario-653686193 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-d364bac4-39a7-4f1d-a524-3d895264674d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58d6f73f-cb1a-4bac-8c06-b4f222d43bff', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:17:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-daf5cf53-cc3b-4f17-88f8-84f72720acf3 req-dcd11519-77ba-482e-b68f-4f2a03c3f1cd tempest-TestServerVolumeAttachmentScenario-653686193 None] attachment_update completed successfully. Sep 01 02:17:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Creating offline snapshot 95c9b478-cd6e-4da3-aef0-6db729303425 of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44c434b-0674-4c5e-9383-fa11e72d3989]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:01 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb Sep 01 02:17:01 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:01 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-76974e9b-e8e3-4152-aeea-2f419d48e2ea req-40a41a0a-6d07-4088-89c3-6db8165084aa tempest-TestServerVolumeAttachmentScenario-653686193 None] Terminate volume connection completed successfully. Sep 01 02:17:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-76974e9b-e8e3-4152-aeea-2f419d48e2ea req-40a41a0a-6d07-4088-89c3-6db8165084aa tempest-TestServerVolumeAttachmentScenario-653686193 None] Deleting attachment 58d6f73f-cb1a-4bac-8c06-b4f222d43bff. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:17:01 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" returned: 0 in 0.362s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:01 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 1G Sep 01 02:17:01 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:02 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 1G" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:02 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:02 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:02 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.293s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:02 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 is being set with open permissions: ugo+rw Sep 01 02:17:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:02 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:02 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:02 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.253s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:02 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.info Sep 01 02:17:02 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:03 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.info" returned: 0 in 0.271s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:03 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.info is being set with open permissions: ugo+rw Sep 01 02:17:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:03 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.info Sep 01 02:17:03 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:03 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-7ef9e436-2473-4de3-af4d-a1f34080f02b req-55c9efb8-b76a-4b7d-9116-94ed5755641f tempest-TestServerVolumeAttachmentScenario-653686193 None] Terminate volume connection completed successfully. Sep 01 02:17:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-7ef9e436-2473-4de3-af4d-a1f34080f02b req-55c9efb8-b76a-4b7d-9116-94ed5755641f tempest-TestServerVolumeAttachmentScenario-653686193 None] Deleting attachment de629e94-44bc-4171-b4c1-b13e4721e6a7. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:17:03 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.info" returned: 0 in 0.285s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:03 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e0df0553-2d60-4ad2-8d69-f9083e1d6303 tempest-SnapshotsActionsTest-988590588 None] Create snapshot completed successfully Sep 01 02:17:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Creating offline snapshot 01a8fdf8-1b91-43ac-a6ee-99dc8645186b of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:05 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0685cf-bbfb-416a-b202-90f488cb57c1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:05 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:05 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:05 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.399s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:05 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b 1G Sep 01 02:17:05 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b 1G" returned: 0 in 0.519s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:06 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b Sep 01 02:17:06 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:06 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:17:06 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b" returned: 0 in 0.364s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b is being set with open permissions: ugo+rw Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:06 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b Sep 01 02:17:06 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.281s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:17:06 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b" returned: 0 in 0.268s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.649s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-276a9bb9-6fa8-4764-8d5f-b2d103c93b72 tempest-SnapshotsActionsTest-988590588 None] Create snapshot completed successfully Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-01a8fdf8-1b91-43ac-a6ee-99dc8645186b-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-01a8fdf8-1b91-43ac-a6ee-99dc8645186b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-quobyte-01a8fdf8-1b91-43ac-a6ee-99dc8645186b" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-01a8fdf8-1b91-43ac-a6ee-99dc8645186b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Deleting offline snapshot 01a8fdf8-1b91-43ac-a6ee-99dc8645186b of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] snapshot_file for this snap is: volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[08691b4d-d4cb-4e7f-82a9-bc9549700a44]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:07 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b Sep 01 02:17:07 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:07 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a50750-f3a0-451d-b4fa-0cea6ece7234]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "cinder-d364bac4-39a7-4f1d-a524-3d895264674d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "cinder-d364bac4-39a7-4f1d-a524-3d895264674d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:08 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:08 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "cinder-quobyte-d364bac4-39a7-4f1d-a524-3d895264674d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "cinder-quobyte-d364bac4-39a7-4f1d-a524-3d895264674d" acquired by "delete_volume" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5749b7-681f-4ba9-8de8-e6fdd86bc5b3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:08 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d Sep 01 02:17:08 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:08 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.396s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:08 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b Sep 01 02:17:08 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:08 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d" returned: 0 in 0.453s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:08 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d Sep 01 02:17:08 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:08 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b" returned: 0 in 0.437s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:08 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b Sep 01 02:17:08 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:08 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d364bac4-39a7-4f1d-a524-3d895264674d" returned: 0 in 0.298s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "cinder-quobyte-d364bac4-39a7-4f1d-a524-3d895264674d" released by "delete_volume" :: held 0.791s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Created reservations ['2ecc7846-aec6-4693-a5aa-1f58860976c5', 'b87abca4-e331-4e24-b947-1882db6e89e6', '2a0c4863-8ded-4b23-adb7-0311926d9e7d', '76a5468c-c26e-4718-9174-76b5d89fdc7f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:08 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:17:08 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:09 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.01a8fdf8-1b91-43ac-a6ee-99dc8645186b" returned: 0 in 0.284s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-01a8fdf8-1b91-43ac-a6ee-99dc8645186b" released by "_delete_snapshot" :: held 1.628s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" released by "delete_snapshot" :: held 1.653s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "cinder-0cf15fcf-38c5-4ee1-8974-78273a4e5e19-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Created reservations ['a4e3f047-3506-4917-9b2f-cc630c9abf49', '98449677-3b33-4a90-b84b-815da53af9a6', '3d2158a2-d64e-402c-b5d1-77c90d11f6d8', '6fd90835-9b6b-41fc-978b-a75dbd8b7378'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "cinder-0cf15fcf-38c5-4ee1-8974-78273a4e5e19-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "cinder-quobyte-0cf15fcf-38c5-4ee1-8974-78273a4e5e19" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "cinder-quobyte-0cf15fcf-38c5-4ee1-8974-78273a4e5e19" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:09 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.312s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Delete snapshot completed successfully. Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[192d2bf6-26f9-4c52-bc4b-75afe67dfaa1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Deleted volume successfully. Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f16af67c-10c3-4b14-aec4-98482aad4c0a tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-01a8fdf8-1b91-43ac-a6ee-99dc8645186b-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a16a1e9e-a110-4a0a-8f8e-d1e40db9989a tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "cinder-d364bac4-39a7-4f1d-a524-3d895264674d-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:09 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 Sep 01 02:17:09 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:09 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19" returned: 0 in 0.398s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:09 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19 Sep 01 02:17:09 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:09 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0cf15fcf-38c5-4ee1-8974-78273a4e5e19" returned: 0 in 0.271s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Creating offline snapshot 38f44997-4784-4d5c-add3-e1f2d9cc30b7 of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "cinder-quobyte-0cf15fcf-38c5-4ee1-8974-78273a4e5e19" released by "delete_volume" :: held 0.758s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[83413747-84d8-4e76-afa6-4fc1ede8a61c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Created reservations ['4db29c59-b21d-4acd-aed8-9c37957692fd', '61c5d8ff-0214-442c-b17b-b51d5a47ec0d', '0ad734eb-a93a-4484-826e-f76da4b03162', 'fc3c22db-f618-45dd-ada7-c9a91f1069df'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:10 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:10 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:17:10 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:10 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.310s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:10 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Deleted volume successfully. Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.465s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-55136297-fa7f-4d33-9707-a06080c0194d tempest-TestServerVolumeAttachmentScenario-653686193 None] Lock "cinder-0cf15fcf-38c5-4ee1-8974-78273a4e5e19-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:10 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 1G Sep 01 02:17:10 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:10 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 1G" returned: 0 in 0.464s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 Sep 01 02:17:10 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:11 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7" returned: 0 in 0.348s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:11 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 is being set with open permissions: ugo+rw Sep 01 02:17:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:11 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 Sep 01 02:17:11 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:11 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7" returned: 0 in 0.289s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.674s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c406df62-e1b7-489e-9b1a-ba68a84f3851 tempest-SnapshotsActionsTest-988590588 None] Create snapshot completed successfully Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-38f44997-4784-4d5c-add3-e1f2d9cc30b7-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-38f44997-4784-4d5c-add3-e1f2d9cc30b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-quobyte-38f44997-4784-4d5c-add3-e1f2d9cc30b7" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-38f44997-4784-4d5c-add3-e1f2d9cc30b7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Deleting offline snapshot 38f44997-4784-4d5c-add3-e1f2d9cc30b7 of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] snapshot_file for this snap is: volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[461c6fbb-086c-4247-aa44-af21b028c621]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:12 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 Sep 01 02:17:12 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:12 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7" returned: 0 in 0.373s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[584fa1d3-b507-49d0-830c-6fc035c1a5af]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:12 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:12 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:13 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.437s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:13 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 Sep 01 02:17:13 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:13 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:13 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7 Sep 01 02:17:13 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:13 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.38f44997-4784-4d5c-add3-e1f2d9cc30b7" returned: 0 in 0.262s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-38f44997-4784-4d5c-add3-e1f2d9cc30b7" released by "_delete_snapshot" :: held 1.559s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" released by "delete_snapshot" :: held 1.583s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Created reservations ['e24ed4a5-853f-4438-8ecd-e8e635a4d9c5', 'ed57a1e2-24df-4bd4-ad51-32884d1dbb5c', '6c0a9e00-69e3-47d7-9db8-20da4627390f', '919f005f-f723-4eee-b552-6eb0cc177f3d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Delete snapshot completed successfully. Sep 01 02:17:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ad8019b-eaf4-48bd-97b8-e856df8a77fd tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-38f44997-4784-4d5c-add3-e1f2d9cc30b7-delete_snapshot" released by "delete_snapshot" :: held 1.752s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Creating offline snapshot fd4e4b1c-808f-498d-8c20-e918cc2a6325 of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c845d7e-52ed-43d9-a8de-8ff784799e07]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:14 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:14 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:15 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.425s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:15 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 1G Sep 01 02:17:15 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:15 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 1G" returned: 0 in 0.481s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:15 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 Sep 01 02:17:15 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:16 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325" returned: 0 in 0.357s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:16 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 is being set with open permissions: ugo+rw Sep 01 02:17:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:16 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 Sep 01 02:17:16 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:16 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325" returned: 0 in 0.268s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.638s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fd5cb857-ce72-478c-ba41-52428491421d tempest-SnapshotsActionsTest-988590588 None] Create snapshot completed successfully Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-fd4e4b1c-808f-498d-8c20-e918cc2a6325-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-fd4e4b1c-808f-498d-8c20-e918cc2a6325-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-quobyte-fd4e4b1c-808f-498d-8c20-e918cc2a6325" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-fd4e4b1c-808f-498d-8c20-e918cc2a6325" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Deleting offline snapshot fd4e4b1c-808f-498d-8c20-e918cc2a6325 of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] snapshot_file for this snap is: volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3016bd-47b1-499c-bb95-bca1456ec57d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:17 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 Sep 01 02:17:17 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:17 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325" returned: 0 in 0.419s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[adab2be1-4dc4-4dcb-b48b-1926b9c7cb4a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:17 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:17 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:17 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.427s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:18 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 Sep 01 02:17:18 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:18 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:18 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325 Sep 01 02:17:18 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:18 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.fd4e4b1c-808f-498d-8c20-e918cc2a6325" returned: 0 in 0.251s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-fd4e4b1c-808f-498d-8c20-e918cc2a6325" released by "_delete_snapshot" :: held 1.589s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" released by "delete_snapshot" :: held 1.614s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:18 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Created reservations ['b13852bd-5530-45ed-81a5-a35398919017', 'edda59f1-c681-4f5c-8baf-965fbfaf1f1c', '0030368a-1e02-445d-9bde-25303a860f93', 'a97ff01d-b2d6-4df2-a3a6-96c850baa8ad'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:18 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Delete snapshot completed successfully. Sep 01 02:17:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e4128030-1cd5-42a7-98b8-46db167d92a0 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-fd4e4b1c-808f-498d-8c20-e918cc2a6325-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Creating offline snapshot 3808586b-c756-4660-9bda-27f3e484d3ad of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:19 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7594503f-c9df-44a1-9ca7-afc086f6ffa2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:19 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:19 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.423s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad 1G Sep 01 02:17:20 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad 1G" returned: 0 in 0.491s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad Sep 01 02:17:20 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad" returned: 0 in 0.316s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad is being set with open permissions: ugo+rw Sep 01 02:17:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad Sep 01 02:17:20 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad" returned: 0 in 0.295s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.629s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c9bf37c2-94d3-4620-8cd4-6c572cd7d376 tempest-SnapshotsActionsTest-988590588 None] Create snapshot completed successfully Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-3808586b-c756-4660-9bda-27f3e484d3ad-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-3808586b-c756-4660-9bda-27f3e484d3ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Acquiring lock "cinder-quobyte-3808586b-c756-4660-9bda-27f3e484d3ad" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-3808586b-c756-4660-9bda-27f3e484d3ad" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Deleting offline snapshot 3808586b-c756-4660-9bda-27f3e484d3ad of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] snapshot_file for this snap is: volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ea5c9c-7a5b-47a6-b1e1-bcd97291d83f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad Sep 01 02:17:21 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad" returned: 0 in 0.385s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:22 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3465998a-8a5b-425b-bda2-a00ad6eb6e3f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:22 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:22 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.408s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:22 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad Sep 01 02:17:22 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad" returned: 0 in 0.443s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad Sep 01 02:17:23 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.3808586b-c756-4660-9bda-27f3e484d3ad" returned: 0 in 0.271s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-3808586b-c756-4660-9bda-27f3e484d3ad" released by "_delete_snapshot" :: held 1.613s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" released by "delete_snapshot" :: held 1.641s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:23 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Created reservations ['de872a1c-3326-4aaf-bd20-7abd79642a97', '9bc5270b-52a4-43f6-bda0-353d3fa31d81', 'eb525280-cdb3-4558-b346-21123197f167', 'f7252c5c-6d15-4591-ad2c-998e00075e2b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Delete snapshot completed successfully. Sep 01 02:17:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fac5af6e-af46-4fe6-b33d-00a8651e0470 tempest-SnapshotsActionsTest-305074323 None] Lock "cinder-3808586b-c756-4660-9bda-27f3e484d3ad-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "cinder-95c9b478-cd6e-4da3-aef0-6db729303425-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-95c9b478-cd6e-4da3-aef0-6db729303425-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "cinder-quobyte-95c9b478-cd6e-4da3-aef0-6db729303425" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-quobyte-95c9b478-cd6e-4da3-aef0-6db729303425" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Deleting offline snapshot 95c9b478-cd6e-4da3-aef0-6db729303425 of volume afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] snapshot_file for this snap is: volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[84184d8d-4def-419b-aec7-33868f02ddcc]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:24 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.430s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7f1aa6-e5f7-4491-b8e4-bb211324cbc0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb Sep 01 02:17:25 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" returned: 0 in 0.416s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:25 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.394s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425 Sep 01 02:17:25 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:26 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb.95c9b478-cd6e-4da3-aef0-6db729303425" returned: 0 in 0.323s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-quobyte-95c9b478-cd6e-4da3-aef0-6db729303425" released by "_delete_snapshot" :: held 1.695s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" released by "delete_snapshot" :: held 1.726s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Created reservations ['dd446549-bec4-460b-81b2-18e139b1fb4d', '48bcdad3-18b0-4d6b-be95-38659ad64384', 'c9557ee3-3f5b-491d-9bb3-c525cac9a92d', '39c57103-2ee0-4848-83be-70deaab6b1aa'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Delete snapshot completed successfully. Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4e0916a8-fffc-4571-8e3d-57809a5ea93f tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-95c9b478-cd6e-4da3-aef0-6db729303425-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "cinder-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9130655-40ed-4922-8fdd-00063fef580f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:26 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb Sep 01 02:17:26 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:27 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" returned: 0 in 0.395s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:27 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb Sep 01 02:17:27 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:27 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" returned: 0 in 0.279s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-quobyte-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb" released by "delete_volume" :: held 0.729s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Created reservations ['1cb87853-9f1b-4b71-9912-13712331e24d', '1b83fcef-56b0-43cc-8647-8cc786e80028', 'e5f84b22-4292-477a-affe-cbfe34ae8dbb', '1f847547-a3f1-409d-ae70-95fc41417940'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:27 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:17:27 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:27 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.351s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:27 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:28 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Deleted volume successfully. Sep 01 02:17:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-399ecc92-cfb8-4725-91b5-c8f509f07573 tempest-SnapshotsActionsTest-988590588 None] Lock "cinder-afe72f5b-76e6-4bd1-8dc3-7bc2dfd77eeb-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:37 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=104,cinder:UPDATE=102,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:38 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=116,cinder:UPDATE=115,cinder:DELETE=5,cinder:INSERT=26 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Flow 'volume_create_manager' (a4cc3768-7d29-45ab-bb61-a3fe06d26eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799fc417-a382-4bca-93f6-f5031e744ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799fc417-a382-4bca-93f6-f5031e744ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-590450219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbca754-004d-4244-bffc-d3b55837318d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff73dca73dc4405eb2783f7e473536ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:49Z,use_quota=True,user_id='489491e1d5d549bf98254e09286e8cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f365f92-3590-484d-8e71-c99883106a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f365f92-3590-484d-8e71-c99883106a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f719763-c04f-411b-97c0-6c30af05d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f719763-c04f-411b-97c0-6c30af05d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bfbca754-004d-4244-bffc-d3b55837318d', 'volume_name': 'volume-bfbca754-004d-4244-bffc-d3b55837318d', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29ebe40-7abb-4ac3-b6fe-84a746b9b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c29ebe40-7abb-4ac3-b6fe-84a746b9b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecd6c98-f335-4bea-a77a-f146928ca05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:49 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Volume bfbca754-004d-4244-bffc-d3b55837318d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bfbca754-004d-4244-bffc-d3b55837318d', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:17:49 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Trying to clone bfbca754-004d-4244-bffc-d3b55837318d from image 694eb3d8-3f60-4f10-a358-172d9ec581ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:17:50 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb2f8e-f5e6-4721-b950-98841c0b0017]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:50 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD Sep 01 02:17:50 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:50 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff is fetched for user 489491e1d5d549bf98254e09286e8cf1. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4a26f4-4396-4289-b051-a8ae9db65503]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:50 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD Sep 01 02:17:50 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:50 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-590450219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfbca754-004d-4244-bffc-d3b55837318d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff73dca73dc4405eb2783f7e473536ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:49Z,use_quota=True,user_id='489491e1d5d549bf98254e09286e8cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Creating volume bfbca754-004d-4244-bffc-d3b55837318d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:50 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:17:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:50 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d 1073741824 Sep 01 02:17:50 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:51 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d 1073741824" returned: 0 in 0.522s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:51 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d Sep 01 02:17:51 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:51 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d" returned: 0 in 0.296s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:51 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Attempting download of 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume bfbca754-004d-4244-bffc-d3b55837318d. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:17:51 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadeb4f1-bac8-4317-9515-8dfd2b81404d]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_phh6vu_a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:51 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_phh6vu_a Sep 01 02:17:51 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:52 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_phh6vu_a" returned: 0 in 0.348s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_phh6vu_a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:52 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_phh6vu_a Sep 01 02:17:52 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:52 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_phh6vu_a" returned: 1 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_phh6vu_a' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f1d002-e50b-4c10-937c-dce14ae2dd45]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:52 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD Sep 01 02:17:52 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:52 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] 694eb3d8-3f60-4f10-a358-172d9ec581ff was qcow2, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:17:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:53 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d Sep 01 02:17:53 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:54 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d" returned: 0 in 1.913s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:54 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_199a5n6ndevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:17:54 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Converted 112.00 MB image at 58.49 MB/s Sep 01 02:17:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:54 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d 1G Sep 01 02:17:54 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:55 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d 1G" returned: 0 in 0.359s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Downloaded image 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume bfbca754-004d-4244-bffc-d3b55837318d successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff for user 489491e1d5d549bf98254e09286e8cf1 is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Marking volume bfbca754-004d-4244-bffc-d3b55837318d as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Copying metadata from image 694eb3d8-3f60-4f10-a358-172d9ec581ff to bfbca754-004d-4244-bffc-d3b55837318d. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Creating volume glance metadata for volume bfbca754-004d-4244-bffc-d3b55837318d backed by image 694eb3d8-3f60-4f10-a358-172d9ec581ff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecd6c98-f335-4bea-a77a-f146928ca05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfbca754-004d-4244-bffc-d3b55837318d', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c59b2f5-eefc-4522-8b52-d4d418c1ad86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:55 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Volume volume-bfbca754-004d-4244-bffc-d3b55837318d (bfbca754-004d-4244-bffc-d3b55837318d): created successfully Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c59b2f5-eefc-4522-8b52-d4d418c1ad86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Flow 'volume_create_manager' (a4cc3768-7d29-45ab-bb61-a3fe06d26eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-45129f37-cffa-4fab-816a-f861dd8eed50 tempest-TestShelveInstance-871931340 None] Created volume successfully. Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Flow 'volume_create_manager' (646c8d05-ee76-4630-af3e-81e6c4c7c666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138b6b87-3d1d-4b51-abcc-a0063c4730cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138b6b87-3d1d-4b51-abcc-a0063c4730cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1731535366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e61cb87-c5cc-4a9e-9940-c4171257275c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db69977329d44bb183967a9f991e1dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:58Z,use_quota=True,user_id='2737a6bce0ab4634842dc71dd83b198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9445e41c-190e-492c-93ae-ffb5d10eee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9445e41c-190e-492c-93ae-ffb5d10eee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f5effd-90d5-4aee-9828-2739168ab52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f5effd-90d5-4aee-9828-2739168ab52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e61cb87-c5cc-4a9e-9940-c4171257275c', 'volume_name': 'volume-8e61cb87-c5cc-4a9e-9940-c4171257275c', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d3af01-586b-445d-bd0a-354e3398dcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d3af01-586b-445d-bd0a-354e3398dcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715a002e-6a32-4de3-9380-92c0e29ac7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Volume 8e61cb87-c5cc-4a9e-9940-c4171257275c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e61cb87-c5cc-4a9e-9940-c4171257275c', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:17:57 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Trying to clone 8e61cb87-c5cc-4a9e-9940-c4171257275c from image 694eb3d8-3f60-4f10-a358-172d9ec581ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:17:58 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:17:58 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:17:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7dd6d4-58c9-482c-9167-ab36bdc7dc69]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:58 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD Sep 01 02:17:58 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:58 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:58 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff is fetched for user 2737a6bce0ab4634842dc71dd83b198e. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:17:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e68f9af-a325-4d15-abe0-7ce8508f5a36]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:59 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD Sep 01 02:17:59 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-040be64f-8766-4cde-8910-3ea18aaecbc2 req-3c4a58b1-7e97-497c-a968-1eaefb78090c tempest-TestShelveInstance-871931340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-040be64f-8766-4cde-8910-3ea18aaecbc2 req-3c4a58b1-7e97-497c-a968-1eaefb78090c tempest-TestShelveInstance-871931340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-040be64f-8766-4cde-8910-3ea18aaecbc2 req-3c4a58b1-7e97-497c-a968-1eaefb78090c tempest-TestShelveInstance-871931340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:59 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1731535366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e61cb87-c5cc-4a9e-9940-c4171257275c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db69977329d44bb183967a9f991e1dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:58Z,use_quota=True,user_id='2737a6bce0ab4634842dc71dd83b198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Creating volume 8e61cb87-c5cc-4a9e-9940-c4171257275c {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:59 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:59 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c 1073741824 Sep 01 02:17:59 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-040be64f-8766-4cde-8910-3ea18aaecbc2 req-3c4a58b1-7e97-497c-a968-1eaefb78090c tempest-TestShelveInstance-871931340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-bfbca754-004d-4244-bffc-d3b55837318d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9910b357-5b23-4a8d-8590-900247af5ba3', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:17:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-040be64f-8766-4cde-8910-3ea18aaecbc2 req-3c4a58b1-7e97-497c-a968-1eaefb78090c tempest-TestShelveInstance-871931340 None] attachment_update completed successfully. Sep 01 02:18:00 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c 1073741824" returned: 0 in 0.713s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:00 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c Sep 01 02:18:00 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:00 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c" returned: 0 in 0.292s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Attempting download of 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume 8e61cb87-c5cc-4a9e-9940-c4171257275c. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7fdf3b-d3df-4895-9793-38042eafcef4]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_6o38yx46 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:00 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_6o38yx46 Sep 01 02:18:00 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:00 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_6o38yx46" returned: 0 in 0.363s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_6o38yx46 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:01 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_6o38yx46 Sep 01 02:18:01 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:01 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_6o38yx46" returned: 1 in 0.368s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_6o38yx46' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:18:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef55e78-21e3-4875-aa6e-24beb724e4c6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:01 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD Sep 01 02:18:01 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:01 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:01 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] 694eb3d8-3f60-4f10-a358-172d9ec581ff was qcow2, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:18:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:01 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c Sep 01 02:18:01 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:04 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c" returned: 0 in 2.507s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_wz4gg0_2devstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:18:04 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Converted 112.00 MB image at 44.64 MB/s Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:04 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c 1G Sep 01 02:18:04 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:04 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c 1G" returned: 0 in 0.523s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Downloaded image 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume 8e61cb87-c5cc-4a9e-9940-c4171257275c successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff for user 2737a6bce0ab4634842dc71dd83b198e is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Marking volume 8e61cb87-c5cc-4a9e-9940-c4171257275c as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Copying metadata from image 694eb3d8-3f60-4f10-a358-172d9ec581ff to 8e61cb87-c5cc-4a9e-9940-c4171257275c. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Creating volume glance metadata for volume 8e61cb87-c5cc-4a9e-9940-c4171257275c backed by image 694eb3d8-3f60-4f10-a358-172d9ec581ff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715a002e-6a32-4de3-9380-92c0e29ac7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e61cb87-c5cc-4a9e-9940-c4171257275c', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dd17ef-a882-4424-80c8-31ed91830fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:04 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Volume volume-8e61cb87-c5cc-4a9e-9940-c4171257275c (8e61cb87-c5cc-4a9e-9940-c4171257275c): created successfully Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dd17ef-a882-4424-80c8-31ed91830fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Flow 'volume_create_manager' (646c8d05-ee76-4630-af3e-81e6c4c7c666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:04 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6628c9c1-d8b7-478e-99dd-d5f82655fc93 tempest-VolumesExtendTest-1613501152 None] Created volume successfully. Sep 01 02:18:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5c471e90-5ff3-4bf3-b502-5ebc16f6e6de tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5c471e90-5ff3-4bf3-b502-5ebc16f6e6de tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:05 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b25865-7244-4365-aca8-b0183cedc317]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c471e90-5ff3-4bf3-b502-5ebc16f6e6de tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:05 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c Sep 01 02:18:05 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:05 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c471e90-5ff3-4bf3-b502-5ebc16f6e6de tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c" returned: 0 in 0.468s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c471e90-5ff3-4bf3-b502-5ebc16f6e6de tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c 2G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5c471e90-5ff3-4bf3-b502-5ebc16f6e6de tempest-VolumesExtendTest-1613501152 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c 2G" returned: 0 in 0.134s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5c471e90-5ff3-4bf3-b502-5ebc16f6e6de tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.625s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:05 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5c471e90-5ff3-4bf3-b502-5ebc16f6e6de tempest-VolumesExtendTest-1613501152 None] Extend volume completed successfully. Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:06 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:18:06 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "cinder-8e61cb87-c5cc-4a9e-9940-c4171257275c-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Lock "cinder-8e61cb87-c5cc-4a9e-9940-c4171257275c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "cinder-quobyte-8e61cb87-c5cc-4a9e-9940-c4171257275c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:06 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.466s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Lock "cinder-quobyte-8e61cb87-c5cc-4a9e-9940-c4171257275c" acquired by "delete_volume" :: waited 0.050s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db81bce-fa1f-497f-8473-6239d5f5eccf]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c Sep 01 02:18:07 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:07 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c" returned: 0 in 0.462s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c Sep 01 02:18:07 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:07 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8e61cb87-c5cc-4a9e-9940-c4171257275c" returned: 0 in 0.347s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Lock "cinder-quobyte-8e61cb87-c5cc-4a9e-9940-c4171257275c" released by "delete_volume" :: held 0.875s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Created reservations ['4f3d6dd5-73f2-4785-8258-d9a45b45c42a', 'b69223ab-f76c-4b90-81a8-a23b4f93ed08', 'd9699c01-ea82-4695-83f7-2d81f2e6c9ea', 'cda7990e-ef37-448a-856f-e9c30cc58776'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:07 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:18:07 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:08 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.334s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Deleted volume successfully. Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b00df437-6491-4396-868b-b27cc8c91247 tempest-VolumesExtendTest-1613501152 None] Lock "cinder-8e61cb87-c5cc-4a9e-9940-c4171257275c-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Flow 'volume_create_manager' (0306fb92-0e7f-481a-9eae-9d30994a3aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba6f1c8-d6e4-42c2-9c56-8a420000e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba6f1c8-d6e4-42c2-9c56-8a420000e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-299434702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4892efe-5cb5-4c7e-9c88-edf1133ed7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db69977329d44bb183967a9f991e1dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:09Z,use_quota=True,user_id='2737a6bce0ab4634842dc71dd83b198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca5fe4c-0384-438e-a0fc-83f11ea64051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca5fe4c-0384-438e-a0fc-83f11ea64051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732eff2c-546b-4f00-a112-1bb1d5964274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732eff2c-546b-4f00-a112-1bb1d5964274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4892efe-5cb5-4c7e-9c88-edf1133ed7f0', 'volume_name': 'volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165ea68f-fd0e-4e74-bb79-602c8994f5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165ea68f-fd0e-4e74-bb79-602c8994f5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a65161-1bc9-4096-a0fd-cb05e3ef46ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Volume d4892efe-5cb5-4c7e-9c88-edf1133ed7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0', 'volume_size': 1} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-299434702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4892efe-5cb5-4c7e-9c88-edf1133ed7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db69977329d44bb183967a9f991e1dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:09Z,use_quota=True,user_id='2737a6bce0ab4634842dc71dd83b198e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Creating volume d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:08 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:18:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:08 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 1073741824 Sep 01 02:18:08 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:09 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 1073741824" returned: 0 in 0.610s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:09 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 Sep 01 02:18:09 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:09 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" returned: 0 in 0.473s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a65161-1bc9-4096-a0fd-cb05e3ef46ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410552c5-4e00-4d64-917a-7e96d4a63fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:10 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Volume volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 (d4892efe-5cb5-4c7e-9c88-edf1133ed7f0): created successfully Sep 01 02:18:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410552c5-4e00-4d64-917a-7e96d4a63fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:10 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Flow 'volume_create_manager' (0306fb92-0e7f-481a-9eae-9d30994a3aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7fa30898-f563-4bd9-b95a-07527ed09074 tempest-VolumesExtendTest-1613501152 None] Created volume successfully. Sep 01 02:18:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Creating offline snapshot 12501fd6-bc5b-4263-a01a-56c13205e7e4 of volume d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:11 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c9ab79-08c3-45ce-9e9a-6669ac938600]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:11 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 Sep 01 02:18:11 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:11 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" returned: 0 in 0.458s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:11 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 1G Sep 01 02:18:11 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:12 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 1G" returned: 0 in 0.460s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:12 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 Sep 01 02:18:12 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:12 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4" returned: 0 in 0.337s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:12 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 is being set with open permissions: ugo+rw Sep 01 02:18:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:12 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 Sep 01 02:18:12 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:12 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4" returned: 0 in 0.293s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:12 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.info Sep 01 02:18:12 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:13 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.info" returned: 0 in 0.293s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:13 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.info is being set with open permissions: ugo+rw Sep 01 02:18:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:13 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.info Sep 01 02:18:13 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:13 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.info" returned: 0 in 0.274s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-88b81e96-f3ca-4873-b02e-3248e53378b8 tempest-VolumesExtendTest-1613501152 None] Create snapshot completed successfully Sep 01 02:18:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-880be1db-fb68-442c-a416-734e94fad2f1 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-880be1db-fb68-442c-a416-734e94fad2f1 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd40c61-944f-4d67-9893-9c5e3c319446]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-880be1db-fb68-442c-a416-734e94fad2f1 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:14 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 Sep 01 02:18:14 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:14 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-880be1db-fb68-442c-a416-734e94fad2f1 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" returned: 0 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-880be1db-fb68-442c-a416-734e94fad2f1 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 2G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-880be1db-fb68-442c-a416-734e94fad2f1 tempest-VolumesExtendTest-1613501152 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 2G" returned: 0 in 0.135s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-880be1db-fb68-442c-a416-734e94fad2f1 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.590s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-880be1db-fb68-442c-a416-734e94fad2f1 tempest-VolumesExtendTest-1613501152 None] Extend volume completed successfully. Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Acquiring lock "cinder-12501fd6-bc5b-4263-a01a-56c13205e7e4-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Lock "cinder-12501fd6-bc5b-4263-a01a-56c13205e7e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Acquiring lock "cinder-quobyte-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Lock "cinder-quobyte-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Acquiring lock "cinder-quobyte-12501fd6-bc5b-4263-a01a-56c13205e7e4" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Lock "cinder-quobyte-12501fd6-bc5b-4263-a01a-56c13205e7e4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Deleting offline snapshot 12501fd6-bc5b-4263-a01a-56c13205e7e4 of volume d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] snapshot_file for this snap is: volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91b756d-3240-4db8-8af9-fb1e80ae11e0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 Sep 01 02:18:16 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:16 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4" returned: 0 in 0.420s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:16 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4bb80b-a08f-4eac-8e5d-8fae2dbdf293]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 Sep 01 02:18:16 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:16 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" returned: 0 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 Sep 01 02:18:16 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4" returned: 0 in 0.393s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:17 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4 Sep 01 02:18:17 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0.12501fd6-bc5b-4263-a01a-56c13205e7e4" returned: 0 in 0.288s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Lock "cinder-quobyte-12501fd6-bc5b-4263-a01a-56c13205e7e4" released by "_delete_snapshot" :: held 1.649s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Lock "cinder-quobyte-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" released by "delete_snapshot" :: held 1.675s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:17 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Created reservations ['928e1a40-d5d7-4009-8500-cfb19046cf2f', '9bef2b9d-5fd5-4565-91c7-9ef93d00633f', '5ace1854-7929-42e8-8579-811e9d1d0ab8', '475ef2d8-447d-4088-83e7-e561d7852d10'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Delete snapshot completed successfully. Sep 01 02:18:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-04905913-b154-47a5-8f9e-ed0ea90e551c tempest-VolumesExtendTest-1613501152 None] Lock "cinder-12501fd6-bc5b-4263-a01a-56c13205e7e4-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "cinder-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Lock "cinder-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "cinder-quobyte-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Lock "cinder-quobyte-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa0da9f-51fc-4ba8-862a-2e733f3931de]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:18 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 Sep 01 02:18:18 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:18 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" returned: 0 in 0.386s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:18 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0 Sep 01 02:18:18 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:18 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" returned: 0 in 0.261s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Lock "cinder-quobyte-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0" released by "delete_volume" :: held 0.706s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Created reservations ['438309a1-b222-482e-bbed-36ec69751d8c', 'bf2c8b86-e7b1-4228-82e2-f073f782a1f6', 'b48a2848-dec5-404c-993a-6302576b61d7', '083b96fe-6067-4902-bad2-2af42251399d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:18:19 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.280s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:19 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Deleted volume successfully. Sep 01 02:18:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0571ef8d-ab77-4957-8558-eda62f2366b9 tempest-VolumesExtendTest-1613501152 None] Lock "cinder-d4892efe-5cb5-4c7e-9c88-edf1133ed7f0-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (925adb0a-8786-4b77-89db-654301d37efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b8da1a-6494-4cdf-aa07-a4f6c929f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b8da1a-6494-4cdf-aa07-a4f6c929f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2135288782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833ce2cb-c44f-44fb-bba7-bd49d39664a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:23Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c96403-413e-464f-a480-e67d68f636a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c96403-413e-464f-a480-e67d68f636a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d770782-6fa6-4762-ad25-3bb424045e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d770782-6fa6-4762-ad25-3bb424045e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '833ce2cb-c44f-44fb-bba7-bd49d39664a4', 'volume_name': 'volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ac4ac6-5a16-4afa-8f69-4082d98c5c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99ac4ac6-5a16-4afa-8f69-4082d98c5c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02147594-2b62-42cb-9ab5-92f5f3f153f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Volume 833ce2cb-c44f-44fb-bba7-bd49d39664a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4', 'volume_size': 1} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2135288782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833ce2cb-c44f-44fb-bba7-bd49d39664a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:23Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Creating volume 833ce2cb-c44f-44fb-bba7-bd49d39664a4 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:22 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:18:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:22 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 1073741824 Sep 01 02:18:22 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:23 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 1073741824" returned: 0 in 0.446s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:23 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 Sep 01 02:18:23 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:23 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4" returned: 0 in 0.270s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02147594-2b62-42cb-9ab5-92f5f3f153f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9e43c4-6afe-405b-90ce-3b66a944b02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Volume volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 (833ce2cb-c44f-44fb-bba7-bd49d39664a4): created successfully Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9e43c4-6afe-405b-90ce-3b66a944b02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (925adb0a-8786-4b77-89db-654301d37efd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-de952fc5-3cea-45a5-a91d-a44572675e46 tempest-VolumesGetTest-730026650 None] Created volume successfully. Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (7166d15f-9134-44e5-b75e-f46cfc2ae2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a180fa4d-5124-48c3-9a1f-9b1ceed49820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a180fa4d-5124-48c3-9a1f-9b1ceed49820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1017378165',display_name='tempest-VolumesGetTest-Volume-712825515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dca235-df04-4c87-8ac2-d0f1759f33fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:24Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4352c8-efa5-474a-91bc-fe14c4a6ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4352c8-efa5-474a-91bc-fe14c4a6ac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3638d263-cdb7-4017-b320-350d7520581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3638d263-cdb7-4017-b320-350d7520581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59dca235-df04-4c87-8ac2-d0f1759f33fe', 'volume_name': 'volume-59dca235-df04-4c87-8ac2-d0f1759f33fe', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9d3621-0b80-434f-995e-769289a3971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9d3621-0b80-434f-995e-769289a3971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4fbf91-d5eb-40fe-af0f-c3cb00c94220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:24 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Volume 59dca235-df04-4c87-8ac2-d0f1759f33fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59dca235-df04-4c87-8ac2-d0f1759f33fe', 'volume_size': 1} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1017378165',display_name='tempest-VolumesGetTest-Volume-712825515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dca235-df04-4c87-8ac2-d0f1759f33fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:24Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Creating volume 59dca235-df04-4c87-8ac2-d0f1759f33fe {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:24 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:18:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:24 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe 1073741824 Sep 01 02:18:24 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:25 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe 1073741824" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:25 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe Sep 01 02:18:25 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:25 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe" returned: 0 in 0.274s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4fbf91-d5eb-40fe-af0f-c3cb00c94220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59dca235-df04-4c87-8ac2-d0f1759f33fe', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422e8c07-fede-4d39-9d1f-c7c2a3efc01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:25 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Volume volume-59dca235-df04-4c87-8ac2-d0f1759f33fe (59dca235-df04-4c87-8ac2-d0f1759f33fe): created successfully Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422e8c07-fede-4d39-9d1f-c7c2a3efc01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (7166d15f-9134-44e5-b75e-f46cfc2ae2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8048478a-71cb-4a9d-ac40-65384cce4435 tempest-VolumesGetTest-730026650 None] Created volume successfully. Sep 01 02:18:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-59dca235-df04-4c87-8ac2-d0f1759f33fe-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Lock "cinder-59dca235-df04-4c87-8ac2-d0f1759f33fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-59dca235-df04-4c87-8ac2-d0f1759f33fe" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-59dca235-df04-4c87-8ac2-d0f1759f33fe" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff93c78-f18a-404f-967f-9931302592b2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:26 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe Sep 01 02:18:26 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:27 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe" returned: 0 in 0.361s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:27 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe Sep 01 02:18:27 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:27 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-59dca235-df04-4c87-8ac2-d0f1759f33fe" returned: 0 in 0.308s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-59dca235-df04-4c87-8ac2-d0f1759f33fe" released by "delete_volume" :: held 0.715s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Created reservations ['d776bc1c-d266-4553-80e8-b87989871119', '33e3d161-c9c5-498d-9a0b-64699cdf10e7', '0a2c4390-28c0-4818-9611-29172ef4a752', '838a01a2-8b49-4d96-8703-0b2cae3ca499'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:27 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:18:27 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:27 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.308s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Deleted volume successfully. Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-833ce2cb-c44f-44fb-bba7-bd49d39664a4-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-873139d2-3dfc-4438-9928-35802c49c08e tempest-VolumesGetTest-730026650 None] Lock "cinder-59dca235-df04-4c87-8ac2-d0f1759f33fe-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Lock "cinder-833ce2cb-c44f-44fb-bba7-bd49d39664a4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-833ce2cb-c44f-44fb-bba7-bd49d39664a4" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-833ce2cb-c44f-44fb-bba7-bd49d39664a4" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4980f2-add6-4375-a5b5-8a03528df9eb]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:28 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 Sep 01 02:18:28 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:28 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4" returned: 0 in 0.439s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:28 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4 Sep 01 02:18:28 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:28 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-833ce2cb-c44f-44fb-bba7-bd49d39664a4" returned: 0 in 0.273s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-833ce2cb-c44f-44fb-bba7-bd49d39664a4" released by "delete_volume" :: held 0.758s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Created reservations ['3be54730-7b03-461c-b40e-cdb55e11f450', 'b3626502-a228-4aeb-8be9-dd80e17e19de', 'a4426a70-9f6e-4e77-8457-e175d61a04da', 'e3dae141-38fa-4631-9490-b969bb801d52'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:28 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:18:28 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:29 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Deleted volume successfully. Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4b00273b-41ed-464a-bc2e-6b58c43b8230 tempest-VolumesGetTest-730026650 None] Lock "cinder-833ce2cb-c44f-44fb-bba7-bd49d39664a4-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (5dfe7cf1-5335-40ae-b492-80d0993137ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc4e805-09d8-4ea8-9ae3-9cf02f127830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc4e805-09d8-4ea8-9ae3-9cf02f127830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1683253030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2206cedc-7146-43b6-96a6-68d74a623be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:30Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c9bf1b-42a4-4212-ab22-b327ef22e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c9bf1b-42a4-4212-ab22-b327ef22e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfebe9ab-cd99-41c3-9391-12f167576830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfebe9ab-cd99-41c3-9391-12f167576830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2206cedc-7146-43b6-96a6-68d74a623be9', 'volume_name': 'volume-2206cedc-7146-43b6-96a6-68d74a623be9', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ae5065-cc47-4a1c-aef5-c0723dca4551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ae5065-cc47-4a1c-aef5-c0723dca4551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6359f545-9628-4b24-9140-0054727f5427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:29 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Volume 2206cedc-7146-43b6-96a6-68d74a623be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2206cedc-7146-43b6-96a6-68d74a623be9', 'volume_size': 1} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1683253030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2206cedc-7146-43b6-96a6-68d74a623be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:30Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Creating volume 2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:29 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:18:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:29 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 1073741824 Sep 01 02:18:29 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:30 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 1073741824" returned: 0 in 0.490s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:30 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 Sep 01 02:18:30 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:30 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9" returned: 0 in 0.285s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6359f545-9628-4b24-9140-0054727f5427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2206cedc-7146-43b6-96a6-68d74a623be9', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a67a75-59aa-406d-8b83-1b17cf03c3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:30 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Volume volume-2206cedc-7146-43b6-96a6-68d74a623be9 (2206cedc-7146-43b6-96a6-68d74a623be9): created successfully Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a67a75-59aa-406d-8b83-1b17cf03c3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (5dfe7cf1-5335-40ae-b492-80d0993137ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4b1b6fdc-0374-43e2-b0f9-f3e6dabf4a72 tempest-VolumesGetTest-730026650 None] Created volume successfully. Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (f422f621-4e29-4b3b-a666-e52844d257c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc02eb7c-5e3d-447b-9da5-f112991130fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc02eb7c-5e3d-447b-9da5-f112991130fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-757108693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a5f47cc-8825-4e55-a913-556c77170ab8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2206cedc-7146-43b6-96a6-68d74a623be9,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:32Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e287e76e-b816-4b4a-ac19-8dce76dd6bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e287e76e-b816-4b4a-ac19-8dce76dd6bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c2717b-26b7-4ef3-a5e8-ac4fec3700e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c2717b-26b7-4ef3-a5e8-ac4fec3700e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1a5f47cc-8825-4e55-a913-556c77170ab8', 'volume_name': 'volume-1a5f47cc-8825-4e55-a913-556c77170ab8', 'volume_size': 1, 'source_volid': '2206cedc-7146-43b6-96a6-68d74a623be9', 'source_volstatus': 'available'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b759c60-c604-4f6c-9f33-9147dd31c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b759c60-c604-4f6c-9f33-9147dd31c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31602eb4-8002-48d9-b78e-d29f28983f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Volume 1a5f47cc-8825-4e55-a913-556c77170ab8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1a5f47cc-8825-4e55-a913-556c77170ab8', 'volume_size': 1, 'source_volid': '2206cedc-7146-43b6-96a6-68d74a623be9', 'source_volstatus': 'available'} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:32 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Cloning volume 2206cedc-7146-43b6-96a6-68d74a623be9 to volume 1a5f47cc-8825-4e55-a913-556c77170ab8 Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Creating offline snapshot 0e9778c8-f428-457b-88b3-5883ed973685 of volume 2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf703d7-35fe-404a-be7b-2006474e69df]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:32 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 Sep 01 02:18:32 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:32 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:32 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 1G Sep 01 02:18:32 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:33 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 1G" returned: 0 in 0.517s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2206cedc-7146-43b6-96a6-68d74a623be9 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:33 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2206cedc-7146-43b6-96a6-68d74a623be9 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 Sep 01 02:18:33 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:33 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2206cedc-7146-43b6-96a6-68d74a623be9 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685" returned: 0 in 0.374s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:33 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 is being set with open permissions: ugo+rw Sep 01 02:18:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:33 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 Sep 01 02:18:33 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:33 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685" returned: 0 in 0.258s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.info Sep 01 02:18:34 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.info" returned: 0 in 0.275s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.info is being set with open permissions: ugo+rw Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.info Sep 01 02:18:34 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:34 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.info" returned: 0 in 0.269s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-1a5f47cc-8825-4e55-a913-556c77170ab8" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-1a5f47cc-8825-4e55-a913-556c77170ab8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] snapshot: 0e9778c8-f428-457b-88b3-5883ed973685, volume: 1a5f47cc-8825-4e55-a913-556c77170ab8, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed027d5b-244b-4a4c-ae5d-c86b6e207a59]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:34 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 Sep 01 02:18:34 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685" returned: 0 in 0.416s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2206cedc-7146-43b6-96a6-68d74a623be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8c5ce2-9688-4214-81e0-69b4c114ec2e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 Sep 01 02:18:35 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:35 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-56c19229-c8c4-4d67-8be6-ccd6ebb89657 req-f3806088-d067-4f7d-a3c3-6110438da439 tempest-TestShelveInstance-871931340 None] Terminate volume connection completed successfully. Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-56c19229-c8c4-4d67-8be6-ccd6ebb89657 req-f3806088-d067-4f7d-a3c3-6110438da439 tempest-TestShelveInstance-871931340 None] Deleting attachment 9910b357-5b23-4a8d-8590-900247af5ba3. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9" returned: 0 in 0.663s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:18:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 Sep 01 02:18:35 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:41 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8" returned: 0 in 5.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:18:41 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Converted 1024.00 MB image at 193.82 MB/s Sep 01 02:18:41 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 is being set with open permissions: ugo+rw Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 Sep 01 02:18:41 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:41 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-1a5f47cc-8825-4e55-a913-556c77170ab8" released by "_copy_volume_from_snapshot" :: held 6.751s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=71,cinder:INSERT=28,cinder:UPDATE=62,cinder:DELETE=8 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-0e9778c8-f428-457b-88b3-5883ed973685" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-0e9778c8-f428-457b-88b3-5883ed973685" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Deleting offline snapshot 0e9778c8-f428-457b-88b3-5883ed973685 of volume 2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] snapshot_file for this snap is: volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acb2314-8e0a-40bf-a622-f0389af406a0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 Sep 01 02:18:41 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-656994ac-a240-4d66-8b92-8162e077c59d req-2e35b234-99e1-4e04-92b9-9f0175591057 tempest-TestShelveInstance-871931340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:41 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685" returned: 0 in 0.378s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2206cedc-7146-43b6-96a6-68d74a623be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e167f961-b72e-4c01-8230-b6326a8d6933]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 Sep 01 02:18:41 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:42 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9" returned: 0 in 0.614s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:42 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 Sep 01 02:18:42 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:42 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685" returned: 0 in 0.358s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:42 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685 Sep 01 02:18:42 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:43 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9.0e9778c8-f428-457b-88b3-5883ed973685" returned: 0 in 0.251s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-0e9778c8-f428-457b-88b3-5883ed973685" released by "_delete_snapshot" :: held 1.700s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=76,cinder:SELECT=71,cinder:INSERT=27,cinder:DELETE=3 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.733s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-656994ac-a240-4d66-8b92-8162e077c59d req-2e35b234-99e1-4e04-92b9-9f0175591057 tempest-TestShelveInstance-871931340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.383s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-656994ac-a240-4d66-8b92-8162e077c59d req-2e35b234-99e1-4e04-92b9-9f0175591057 tempest-TestShelveInstance-871931340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31602eb4-8002-48d9-b78e-d29f28983f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a5f47cc-8825-4e55-a913-556c77170ab8', 'volume_size': 1, 'source_volid': '2206cedc-7146-43b6-96a6-68d74a623be9', 'source_volstatus': 'available'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb35cda-6d0f-4d89-b79c-544c907a8798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:43 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Volume volume-1a5f47cc-8825-4e55-a913-556c77170ab8 (1a5f47cc-8825-4e55-a913-556c77170ab8): created successfully Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb35cda-6d0f-4d89-b79c-544c907a8798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (f422f621-4e29-4b3b-a666-e52844d257c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-656994ac-a240-4d66-8b92-8162e077c59d req-2e35b234-99e1-4e04-92b9-9f0175591057 tempest-TestShelveInstance-871931340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-bfbca754-004d-4244-bffc-d3b55837318d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9143c3e3-36d8-4ca2-aed1-8812b36203dc', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:18:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-eb70a648-07a9-4cc3-8e6a-0d8d6f066c7f tempest-VolumesGetTest-730026650 None] Created volume successfully. Sep 01 02:18:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-656994ac-a240-4d66-8b92-8162e077c59d req-2e35b234-99e1-4e04-92b9-9f0175591057 tempest-TestShelveInstance-871931340 None] attachment_update completed successfully. Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (91b7ebd9-98fe-4c8b-9251-76aafd83fe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9f1a38-acec-431a-bec0-0fa13090af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9f1a38-acec-431a-bec0-0fa13090af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-674625770',display_name='tempest-VolumesGetTest-Volume-747318056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cafb84e-9541-466d-87ee-09e6baf09941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:44Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7416d1-5165-48e0-9348-d49cacd3bd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e7416d1-5165-48e0-9348-d49cacd3bd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a053a14a-b30a-484c-83c9-6f9b0ca044b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a053a14a-b30a-484c-83c9-6f9b0ca044b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cafb84e-9541-466d-87ee-09e6baf09941', 'volume_name': 'volume-6cafb84e-9541-466d-87ee-09e6baf09941', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043c1121-f136-463b-83bb-8ceec7bb718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043c1121-f136-463b-83bb-8ceec7bb718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48e4546-fd76-4632-8bcc-f13537833295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:44 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Volume 6cafb84e-9541-466d-87ee-09e6baf09941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cafb84e-9541-466d-87ee-09e6baf09941', 'volume_size': 1} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-674625770',display_name='tempest-VolumesGetTest-Volume-747318056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cafb84e-9541-466d-87ee-09e6baf09941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:44Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Creating volume 6cafb84e-9541-466d-87ee-09e6baf09941 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:44 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 1073741824 Sep 01 02:18:44 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 1073741824" returned: 0 in 0.589s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 Sep 01 02:18:44 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:45 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941" returned: 0 in 0.300s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48e4546-fd76-4632-8bcc-f13537833295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cafb84e-9541-466d-87ee-09e6baf09941', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ca9692-be54-4876-b260-35b29eba1c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:45 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Volume volume-6cafb84e-9541-466d-87ee-09e6baf09941 (6cafb84e-9541-466d-87ee-09e6baf09941): created successfully Sep 01 02:18:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ca9692-be54-4876-b260-35b29eba1c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (91b7ebd9-98fe-4c8b-9251-76aafd83fe66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a2c6a3f1-3175-4a6c-b520-57cb38475e1b tempest-VolumesGetTest-730026650 None] Created volume successfully. Sep 01 02:18:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-6cafb84e-9541-466d-87ee-09e6baf09941-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Lock "cinder-6cafb84e-9541-466d-87ee-09e6baf09941-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-6cafb84e-9541-466d-87ee-09e6baf09941" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-6cafb84e-9541-466d-87ee-09e6baf09941" acquired by "delete_volume" :: waited 0.048s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd7616b-f842-4876-aacb-53b5d3810cb1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:47 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 Sep 01 02:18:47 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:47 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941" returned: 0 in 0.431s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:47 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941 Sep 01 02:18:47 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:47 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6cafb84e-9541-466d-87ee-09e6baf09941" returned: 0 in 0.271s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-6cafb84e-9541-466d-87ee-09e6baf09941" released by "delete_volume" :: held 0.770s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Created reservations ['a84be3b8-3a1d-410b-be41-7395f57b58f5', '94348e2f-f016-4aa8-8616-198d1313cc4d', '9f9d61be-ad4b-4225-ac98-fe3b9e374cf4', '1d24f5ab-83a0-412c-8a7f-a956c422c7d1'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:47 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:18:47 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-1a5f47cc-8825-4e55-a913-556c77170ab8-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:48 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.345s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:48 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Deleted volume successfully. Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Lock "cinder-1a5f47cc-8825-4e55-a913-556c77170ab8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-089b90db-088c-4a95-811b-71ade16971d5 tempest-VolumesGetTest-730026650 None] Lock "cinder-6cafb84e-9541-466d-87ee-09e6baf09941-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-1a5f47cc-8825-4e55-a913-556c77170ab8" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-1a5f47cc-8825-4e55-a913-556c77170ab8" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6f3338-fe1e-4787-bc06-a220fac2871b]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:48 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 Sep 01 02:18:48 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:48 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8" returned: 0 in 0.398s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:48 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8 Sep 01 02:18:48 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:49 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-1a5f47cc-8825-4e55-a913-556c77170ab8" returned: 0 in 0.280s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-1a5f47cc-8825-4e55-a913-556c77170ab8" released by "delete_volume" :: held 0.736s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Created reservations ['f115d321-f6d8-446e-b0db-ef238eb18bc2', '3f93753a-3bf7-4d83-a636-cbc23656b167', 'a1ee9702-719d-4b92-a02a-ab5b3f5a0dd8', 'e1b4faa4-b8ed-440f-9d7c-b08fd06a46cc'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:49 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:18:49 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:49 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.321s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:49 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Deleted volume successfully. Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-2206cedc-7146-43b6-96a6-68d74a623be9-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-541f1aa5-8a00-480a-ac05-06f942b8403c tempest-VolumesGetTest-730026650 None] Lock "cinder-1a5f47cc-8825-4e55-a913-556c77170ab8-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Lock "cinder-2206cedc-7146-43b6-96a6-68d74a623be9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-2206cedc-7146-43b6-96a6-68d74a623be9" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-2206cedc-7146-43b6-96a6-68d74a623be9" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cee408-90db-4c67-90e6-57c1affbdfdf]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:49 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 Sep 01 02:18:49 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:50 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9" returned: 0 in 0.408s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:50 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9 Sep 01 02:18:50 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:50 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-2206cedc-7146-43b6-96a6-68d74a623be9" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-2206cedc-7146-43b6-96a6-68d74a623be9" released by "delete_volume" :: held 0.754s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Created reservations ['f62042f7-7f02-4b29-b46f-f89baeaf0331', '070e029b-1f16-4925-806f-b1007f21a476', '7f13215f-e2cd-46be-9fa1-5143558741b0', 'ed7005b0-19ea-4de9-9797-a7736a46396f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:50 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:18:50 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:50 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.283s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:50 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Deleted volume successfully. Sep 01 02:18:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-45e6d241-420d-4b77-938e-21414660d835 tempest-VolumesGetTest-730026650 None] Lock "cinder-2206cedc-7146-43b6-96a6-68d74a623be9-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:51 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (0ee0e4b0-8557-4f8e-b636-d9da4c412583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d467574c-5178-401c-9164-a5072fa23262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d467574c-5178-401c-9164-a5072fa23262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-241220761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:52Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97120745-984a-400b-9f1d-258e42e71c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97120745-984a-400b-9f1d-258e42e71c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c365665-8ccc-4d25-832a-95eead8334b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:51 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c365665-8ccc-4d25-832a-95eead8334b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48', 'volume_name': 'volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef1bf30-204f-4421-b675-a1e79261b4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef1bf30-204f-4421-b675-a1e79261b4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7a625a-09de-47a5-9c29-7f00fb39e4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:52 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Volume a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Trying to clone a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 from image 694eb3d8-3f60-4f10-a358-172d9ec581ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:18:52 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c4e64-6a86-478b-894d-37e15fc73c2e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:52 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD Sep 01 02:18:52 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:52 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:52 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff is fetched for user 94b3dfed85d24cf58bbf62344830fe73. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[db17abec-8d11-4804-b828-a588ab316d28]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD Sep 01 02:18:53 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:53 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-241220761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:52Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Creating volume a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:53 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 1073741824 Sep 01 02:18:53 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:53 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 1073741824" returned: 0 in 0.441s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 Sep 01 02:18:53 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:54 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48" returned: 0 in 0.260s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Attempting download of 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bc857d-eaf2-48cf-a90e-4121e5b92fb2]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_1ju1udcq {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:54 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_1ju1udcq Sep 01 02:18:54 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:54 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_1ju1udcq" returned: 0 in 0.353s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_1ju1udcq {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:54 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_1ju1udcq Sep 01 02:18:54 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:54 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_1ju1udcq" returned: 1 in 0.338s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_694eb3d8-3f60-4f10-a358-172d9ec581ff_1ju1udcq' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dd7e2a-7b19-43f8-82ac-e46b364e598e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD Sep 01 02:18:55 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:55 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:55 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] 694eb3d8-3f60-4f10-a358-172d9ec581ff was qcow2, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:18:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 Sep 01 02:18:55 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:56 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48" returned: 0 in 1.624s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_694eb3d8-3f60-4f10-a358-172d9ec581ff_tqb5j0l2devstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:18:56 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Converted 112.00 MB image at 68.92 MB/s Sep 01 02:18:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:56 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 1G Sep 01 02:18:56 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:57 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 1G" returned: 0 in 0.312s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Downloaded image 694eb3d8-3f60-4f10-a358-172d9ec581ff ((None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}])) to volume a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Temporary image 694eb3d8-3f60-4f10-a358-172d9ec581ff for user 94b3dfed85d24cf58bbf62344830fe73 is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Marking volume a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Copying metadata from image 694eb3d8-3f60-4f10-a358-172d9ec581ff to a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Creating volume glance metadata for volume a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 backed by image 694eb3d8-3f60-4f10-a358-172d9ec581ff with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7a625a-09de-47a5-9c29-7f00fb39e4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48', 'volume_size': 1, 'image_id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/694eb3d8-3f60-4f10-a358-172d9ec581ff', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c6ebe767e7264b029322e96ccca04343', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '694eb3d8-3f60-4f10-a358-172d9ec581ff', 'created_at': datetime.datetime(2026, 8, 31, 23, 54, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 54, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/694eb3d8-3f60-4f10-a358-172d9ec581ff/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4191d173-7d45-432a-89f6-15283c8e82be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Volume volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 (a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48): created successfully Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4191d173-7d45-432a-89f6-15283c8e82be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (0ee0e4b0-8557-4f8e-b636-d9da4c412583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-2da1503b-0d90-441b-9fd2-d8aa23d111f3 tempest-VolumesGetTest-730026650 None] Created volume successfully. Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (85c5795f-a3a0-4452-8a89-eaf4c3db537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06041829-e8ef-47de-9931-4a898ca79cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06041829-e8ef-47de-9931-4a898ca79cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-24601742',display_name='tempest-VolumesGetTest-Volume-1591802946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6ccbc1-a995-43e2-9b19-33aae60e03e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:59Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689c1eeb-be54-4e17-b3eb-102faa14ee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689c1eeb-be54-4e17-b3eb-102faa14ee17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11485060-56a0-4974-bd15-25c48adce9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11485060-56a0-4974-bd15-25c48adce9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6ccbc1-a995-43e2-9b19-33aae60e03e0', 'volume_name': 'volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26214c9d-5e88-40ab-9ac6-c2a17815e1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26214c9d-5e88-40ab-9ac6-c2a17815e1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99184a1-c004-49a7-b46b-125d445bef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:58 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Volume 6d6ccbc1-a995-43e2-9b19-33aae60e03e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0', 'volume_size': 1} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-24601742',display_name='tempest-VolumesGetTest-Volume-1591802946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6ccbc1-a995-43e2-9b19-33aae60e03e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c50de6967a4cc59e9551a5360f0a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:59Z,use_quota=True,user_id='94b3dfed85d24cf58bbf62344830fe73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Creating volume 6d6ccbc1-a995-43e2-9b19-33aae60e03e0 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:58 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:18:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:58 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 1073741824 Sep 01 02:18:58 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 1073741824" returned: 0 in 0.426s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:59 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 Sep 01 02:18:59 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0" returned: 0 in 0.250s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99184a1-c004-49a7-b46b-125d445bef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207c9f62-6311-4814-b70e-bc71e5d6ab2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Volume volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 (6d6ccbc1-a995-43e2-9b19-33aae60e03e0): created successfully Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207c9f62-6311-4814-b70e-bc71e5d6ab2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Flow 'volume_create_manager' (85c5795f-a3a0-4452-8a89-eaf4c3db537f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5d9b3a4c-e85a-47fe-9229-0fdf20c6ebc7 tempest-VolumesGetTest-730026650 None] Created volume successfully. Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-6d6ccbc1-a995-43e2-9b19-33aae60e03e0-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Lock "cinder-6d6ccbc1-a995-43e2-9b19-33aae60e03e0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-6d6ccbc1-a995-43e2-9b19-33aae60e03e0" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-6d6ccbc1-a995-43e2-9b19-33aae60e03e0" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[676a349f-ae71-484d-a6c1-3d0fdb2c9fa1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:00 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 Sep 01 02:19:00 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:00 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0" returned: 0 in 0.374s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:00 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0 Sep 01 02:19:00 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:00 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6d6ccbc1-a995-43e2-9b19-33aae60e03e0" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-6d6ccbc1-a995-43e2-9b19-33aae60e03e0" released by "delete_volume" :: held 0.669s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Created reservations ['3beb2593-e902-412b-8c7b-59c15e44d07a', 'abefc18a-bf3c-4e26-9e41-e8691db041b4', 'efe4d496-d9d1-4317-940c-e04bac3f3ff2', '51d5617f-f12d-4941-b4f9-67920e52033d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:00 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:19:00 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:00 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.259s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:00 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:01 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Deleted volume successfully. Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-283e4a1b-ccb6-4147-a517-2ead29cfb022 tempest-VolumesGetTest-730026650 None] Lock "cinder-6d6ccbc1-a995-43e2-9b19-33aae60e03e0-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Lock "cinder-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Acquiring lock "cinder-quobyte-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7827cd93-a0ca-4066-bc24-357cf442da0a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:01 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 Sep 01 02:19:01 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:01 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48" returned: 0 in 0.414s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:01 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48 Sep 01 02:19:01 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:01 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48" returned: 0 in 0.273s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Lock "cinder-quobyte-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48" released by "delete_volume" :: held 0.735s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Created reservations ['fb21fb95-247a-49d4-b6fc-e1c068af2f35', 'dde54ce1-f875-4575-8d54-a6127fe5d4b6', 'bec6139b-2204-4bf8-8332-9bb9248a1ebd', '369d8703-6ca1-4d71-bb95-22bf088c56d4'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:02 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:19:02 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:02 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.292s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:02 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Deleted volume successfully. Sep 01 02:19:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-86eeacda-4cd8-42e7-bfef-279db90cbea9 tempest-VolumesGetTest-730026650 None] Lock "cinder-a81ebe4f-1fda-4d6d-8a76-4d8d2b1bca48-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Flow 'volume_create_manager' (991a1897-cf8b-4665-88eb-8c41ce423312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2477b43c-a6ea-4cd0-ab2f-6ae5d4a53414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2477b43c-a6ea-4cd0-ab2f-6ae5d4a53414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-157509123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c96e2f-e687-4838-a45c-d6e5abc815f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f555dc50cf174362b876898ab83123c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:05Z,use_quota=True,user_id='c8a0195dcd1141d0866dbfd4686ceada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133426e2-9bcc-4cd3-9b1a-42f6af769d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (133426e2-9bcc-4cd3-9b1a-42f6af769d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7df6ef-5b1b-471c-bbad-15202509e678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7df6ef-5b1b-471c-bbad-15202509e678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c96e2f-e687-4838-a45c-d6e5abc815f4', 'volume_name': 'volume-52c96e2f-e687-4838-a45c-d6e5abc815f4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6827bfd0-34ab-4118-a8c1-e767d564407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6827bfd0-34ab-4118-a8c1-e767d564407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60440161-3030-434d-8ff2-0dd5ec0c8855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:05 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Volume 52c96e2f-e687-4838-a45c-d6e5abc815f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c96e2f-e687-4838-a45c-d6e5abc815f4', 'volume_size': 1} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-157509123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c96e2f-e687-4838-a45c-d6e5abc815f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f555dc50cf174362b876898ab83123c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:05Z,use_quota=True,user_id='c8a0195dcd1141d0866dbfd4686ceada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Creating volume 52c96e2f-e687-4838-a45c-d6e5abc815f4 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:05 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:05 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 1073741824 Sep 01 02:19:05 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:05 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 1073741824" returned: 0 in 0.417s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:05 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 Sep 01 02:19:05 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4" returned: 0 in 0.262s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60440161-3030-434d-8ff2-0dd5ec0c8855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c96e2f-e687-4838-a45c-d6e5abc815f4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a59879-6441-4e51-9521-edc5e627da1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:06 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Volume volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 (52c96e2f-e687-4838-a45c-d6e5abc815f4): created successfully Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a59879-6441-4e51-9521-edc5e627da1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Flow 'volume_create_manager' (991a1897-cf8b-4665-88eb-8c41ce423312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a11150ba-f42e-4a8f-aa8d-3274b4f27479 tempest-VolumesListTestJSON-1944637853 None] Created volume successfully. Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:06 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:19:06 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Flow 'volume_create_manager' (349aed5e-9261-4be6-a78a-8076c8c9ad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafdfdb3-c976-4520-aeaf-5dd69aa34ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eafdfdb3-c976-4520-aeaf-5dd69aa34ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-789409820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021d97e6-d77b-4297-8fd2-72a0c9fdd553,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f555dc50cf174362b876898ab83123c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:07Z,use_quota=True,user_id='c8a0195dcd1141d0866dbfd4686ceada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f17a21-1ba4-4815-90fd-8dba0c3e3cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f17a21-1ba4-4815-90fd-8dba0c3e3cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62a1a05-4942-4dd8-8527-759bf0bc4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62a1a05-4942-4dd8-8527-759bf0bc4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '021d97e6-d77b-4297-8fd2-72a0c9fdd553', 'volume_name': 'volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daae357-856c-4240-ba25-b751ce036a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daae357-856c-4240-ba25-b751ce036a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f3bb70-137a-4758-a8df-b887bb396f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:07 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Volume 021d97e6-d77b-4297-8fd2-72a0c9fdd553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553', 'volume_size': 1} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-789409820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021d97e6-d77b-4297-8fd2-72a0c9fdd553,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f555dc50cf174362b876898ab83123c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:07Z,use_quota=True,user_id='c8a0195dcd1141d0866dbfd4686ceada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Creating volume 021d97e6-d77b-4297-8fd2-72a0c9fdd553 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:07 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:07 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 1073741824 Sep 01 02:19:07 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:07 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 1073741824" returned: 0 in 0.444s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:07 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 Sep 01 02:19:07 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:07 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553" returned: 0 in 0.277s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f3bb70-137a-4758-a8df-b887bb396f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1512f809-ca68-44af-9c93-ddf8b29d00be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:07 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Volume volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 (021d97e6-d77b-4297-8fd2-72a0c9fdd553): created successfully Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1512f809-ca68-44af-9c93-ddf8b29d00be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Flow 'volume_create_manager' (349aed5e-9261-4be6-a78a-8076c8c9ad59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:07 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-df604ca0-d992-430f-a86f-df21f740127a tempest-VolumesListTestJSON-1944637853 None] Created volume successfully. Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Flow 'volume_create_manager' (8cb82a6c-f291-41f2-8491-e01ef704a814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a132149f-94f6-46d6-a7d8-be381836bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a132149f-94f6-46d6-a7d8-be381836bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2047048682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8604ecaa-0902-4aa3-a72a-96120fa0cf98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f555dc50cf174362b876898ab83123c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:09Z,use_quota=True,user_id='c8a0195dcd1141d0866dbfd4686ceada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25082c86-2dda-43f9-9bf3-6a2364ba0dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25082c86-2dda-43f9-9bf3-6a2364ba0dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4967ee-09c9-42bc-b10d-207191479f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4967ee-09c9-42bc-b10d-207191479f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8604ecaa-0902-4aa3-a72a-96120fa0cf98', 'volume_name': 'volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33f2229-395f-43a2-a402-f29152bdf100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33f2229-395f-43a2-a402-f29152bdf100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3869dfe-76b7-4e11-8d73-4f40e175f42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Volume 8604ecaa-0902-4aa3-a72a-96120fa0cf98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98', 'volume_size': 1} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2047048682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8604ecaa-0902-4aa3-a72a-96120fa0cf98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f555dc50cf174362b876898ab83123c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:09Z,use_quota=True,user_id='c8a0195dcd1141d0866dbfd4686ceada',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Creating volume 8604ecaa-0902-4aa3-a72a-96120fa0cf98 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:08 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:19:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:08 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 1073741824 Sep 01 02:19:08 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:09 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 1073741824" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:09 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 Sep 01 02:19:09 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:09 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98" returned: 0 in 0.290s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3869dfe-76b7-4e11-8d73-4f40e175f42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad12820-838e-4d3f-ad7a-da7fe7db1a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Volume volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 (8604ecaa-0902-4aa3-a72a-96120fa0cf98): created successfully Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad12820-838e-4d3f-ad7a-da7fe7db1a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Flow 'volume_create_manager' (8cb82a6c-f291-41f2-8491-e01ef704a814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5a699c03-ddca-41af-b8c8-5d59faa5f45d tempest-VolumesListTestJSON-1944637853 None] Created volume successfully. Sep 01 02:19:12 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-fb2147e2-1616-4c6d-a99b-213eb0019fdd tempest-TestShelveInstance-871931340 None] Terminate volume connection completed successfully. Sep 01 02:19:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-fb2147e2-1616-4c6d-a99b-213eb0019fdd tempest-TestShelveInstance-871931340 None] Deleting attachment 9143c3e3-36d8-4ca2-aed1-8812b36203dc. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Acquiring lock "cinder-bfbca754-004d-4244-bffc-d3b55837318d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Lock "cinder-bfbca754-004d-4244-bffc-d3b55837318d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Acquiring lock "cinder-quobyte-bfbca754-004d-4244-bffc-d3b55837318d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Lock "cinder-quobyte-bfbca754-004d-4244-bffc-d3b55837318d" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adf8636-a76e-4bbc-9034-a503b48d78ac]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:12 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d Sep 01 02:19:12 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d" returned: 0 in 0.462s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:13 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d Sep 01 02:19:13 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-bfbca754-004d-4244-bffc-d3b55837318d" returned: 0 in 0.271s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Lock "cinder-quobyte-bfbca754-004d-4244-bffc-d3b55837318d" released by "delete_volume" :: held 0.794s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.quota [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Created reservations ['e32d8425-fafa-41ff-9b67-06f7bf875f9c', '8fe5445a-29a2-451c-a025-c7060cab9fff', '23721cce-ba3b-4232-8b1d-b68e9e3fdb91', '8732d452-752f-4a17-9a1b-cf90635582f1'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "cinder-8604ecaa-0902-4aa3-a72a-96120fa0cf98-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-8604ecaa-0902-4aa3-a72a-96120fa0cf98-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:13 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:19:13 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "cinder-quobyte-8604ecaa-0902-4aa3-a72a-96120fa0cf98" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-quobyte-8604ecaa-0902-4aa3-a72a-96120fa0cf98" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd17d8f3-00c3-40e8-8bce-db965699afa3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:13 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 Sep 01 02:19:13 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:13 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.271s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.manager [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Deleted volume successfully. Sep 01 02:19:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [req-25ce9fce-6862-4706-ad42-a68b36d62be1 req-ef5bf96b-aa3f-4243-b252-c08af7ef5ade tempest-TestShelveInstance-871931340 None] Lock "cinder-bfbca754-004d-4244-bffc-d3b55837318d-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:14 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98" returned: 0 in 0.428s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:14 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98 Sep 01 02:19:14 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:14 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-8604ecaa-0902-4aa3-a72a-96120fa0cf98" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-quobyte-8604ecaa-0902-4aa3-a72a-96120fa0cf98" released by "delete_volume" :: held 0.757s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Created reservations ['db8e5a48-57cc-4150-8054-909e5cb8e589', 'fd75aa66-c72d-4cb2-b2a7-0dee3e657d1c', 'e9a0f5a9-7380-4930-8b14-d00eee4d136f', 'd0312425-57b5-4785-bf0e-9b94aff18fab'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:14 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:19:14 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "cinder-021d97e6-d77b-4297-8fd2-72a0c9fdd553-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-021d97e6-d77b-4297-8fd2-72a0c9fdd553-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "cinder-quobyte-021d97e6-d77b-4297-8fd2-72a0c9fdd553" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-quobyte-021d97e6-d77b-4297-8fd2-72a0c9fdd553" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:14 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.369s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Deleted volume successfully. Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dff2c6b-f1e5-4d2a-afd4-12191a99aaa5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5fbbad88-3b07-4a05-9c70-349a542d8d1b tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-8604ecaa-0902-4aa3-a72a-96120fa0cf98-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:15 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 Sep 01 02:19:15 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:15 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553" returned: 0 in 0.437s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:15 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553 Sep 01 02:19:15 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:15 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-021d97e6-d77b-4297-8fd2-72a0c9fdd553" returned: 0 in 0.329s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-quobyte-021d97e6-d77b-4297-8fd2-72a0c9fdd553" released by "delete_volume" :: held 0.821s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Created reservations ['cd638594-8eb0-44bd-bb15-41943ec04fcd', '9bc10731-89a0-42d0-83de-0bb919e62af0', '090c9fc1-0701-463f-8498-2bfb358d75ff', '70148f31-18b0-405e-a042-284f7ce8ec9d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:15 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:19:15 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "cinder-52c96e2f-e687-4838-a45c-d6e5abc815f4-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-52c96e2f-e687-4838-a45c-d6e5abc815f4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:16 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "cinder-quobyte-52c96e2f-e687-4838-a45c-d6e5abc815f4" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.290s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-quobyte-52c96e2f-e687-4838-a45c-d6e5abc815f4" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Deleted volume successfully. Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710bb2d-ae65-47c9-9880-b0481c75bde2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8ee34b80-a136-4c65-8c7a-8dd5f544ebdc tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-021d97e6-d77b-4297-8fd2-72a0c9fdd553-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:16 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 Sep 01 02:19:16 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4" returned: 0 in 0.375s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:16 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4 Sep 01 02:19:16 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-52c96e2f-e687-4838-a45c-d6e5abc815f4" returned: 0 in 0.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-quobyte-52c96e2f-e687-4838-a45c-d6e5abc815f4" released by "delete_volume" :: held 0.683s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Created reservations ['ee07b24b-3b57-4f19-a418-cae42df21e05', '4221e2a4-3c48-4789-a3c2-ab50399a246a', 'd25efa4f-d585-4c42-be4a-6093403b7792', '455c9b86-53c1-4865-9cdf-a92e19724100'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:17 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:19:17 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:17 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.317s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:17 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Deleted volume successfully. Sep 01 02:19:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-bbba7329-2939-4398-ab9e-81478b53c842 tempest-VolumesListTestJSON-1944637853 None] Lock "cinder-52c96e2f-e687-4838-a45c-d6e5abc815f4-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Flow 'volume_create_manager' (e3c7faab-12bc-4c82-a302-86ff58ce63c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376a4fe9-3c7e-4e9c-9a45-4e5391770492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376a4fe9-3c7e-4e9c-9a45-4e5391770492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-491336997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f49ddf-237c-426e-a243-7d38aeba449b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6278e5e4a8479589b11f3db53787e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:21Z,use_quota=True,user_id='32908c50fc5948ac999eb3cef0db8664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd7e05e-6806-40f1-8b83-57bcf487e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd7e05e-6806-40f1-8b83-57bcf487e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323e8e01-2588-4c54-8175-a0609efed91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323e8e01-2588-4c54-8175-a0609efed91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f49ddf-237c-426e-a243-7d38aeba449b', 'volume_name': 'volume-a7f49ddf-237c-426e-a243-7d38aeba449b', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcb4a6a-68b6-446e-9057-18793bc5ad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcb4a6a-68b6-446e-9057-18793bc5ad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24ae520-0178-4ef8-9b5c-048208716d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:20 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Volume a7f49ddf-237c-426e-a243-7d38aeba449b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f49ddf-237c-426e-a243-7d38aeba449b', 'volume_size': 1} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-491336997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f49ddf-237c-426e-a243-7d38aeba449b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6278e5e4a8479589b11f3db53787e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:21Z,use_quota=True,user_id='32908c50fc5948ac999eb3cef0db8664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Creating volume a7f49ddf-237c-426e-a243-7d38aeba449b {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:20 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:19:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:20 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b 1073741824 Sep 01 02:19:20 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:21 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b 1073741824" returned: 0 in 0.501s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:21 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b Sep 01 02:19:21 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:21 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b" returned: 0 in 0.316s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24ae520-0178-4ef8-9b5c-048208716d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f49ddf-237c-426e-a243-7d38aeba449b', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8e26e6-3f7b-4a7d-9c54-b34ca14e71fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:21 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Volume volume-a7f49ddf-237c-426e-a243-7d38aeba449b (a7f49ddf-237c-426e-a243-7d38aeba449b): created successfully Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8e26e6-3f7b-4a7d-9c54-b34ca14e71fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Flow 'volume_create_manager' (e3c7faab-12bc-4c82-a302-86ff58ce63c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c2d69528-e62b-4017-a493-cac466bf22c0 tempest-VolumesNegativeTest-147843347 None] Created volume successfully. Sep 01 02:19:31 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=77,cinder:UPDATE=100,cinder:INSERT=34,cinder:DELETE=5 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:31 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=73,cinder:UPDATE=97,cinder:DELETE=12,cinder:INSERT=23 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Acquiring lock "cinder-a7f49ddf-237c-426e-a243-7d38aeba449b-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Lock "cinder-a7f49ddf-237c-426e-a243-7d38aeba449b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Acquiring lock "cinder-quobyte-a7f49ddf-237c-426e-a243-7d38aeba449b" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Lock "cinder-quobyte-a7f49ddf-237c-426e-a243-7d38aeba449b" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:42 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc52df66-6a42-418f-987a-46ddcc01ebf2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:42 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b Sep 01 02:19:42 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:42 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b" returned: 0 in 0.435s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:42 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b Sep 01 02:19:42 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:43 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a7f49ddf-237c-426e-a243-7d38aeba449b" returned: 0 in 0.323s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Lock "cinder-quobyte-a7f49ddf-237c-426e-a243-7d38aeba449b" released by "delete_volume" :: held 0.818s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Created reservations ['6930f43f-5659-4f90-a6ff-094da6770bb7', '7e11f481-7550-4e55-ae1d-b2f00b8a2d40', '23c16430-a5d7-4bcc-960c-e80685ec3a45', '99cfa14a-954a-44ab-9058-5651d473debc'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:43 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:19:43 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:43 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.322s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Deleted volume successfully. Sep 01 02:19:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7548ee2b-1957-4807-bee3-65eae5b6923c tempest-VolumesNegativeTest-147843347 None] Lock "cinder-a7f49ddf-237c-426e-a243-7d38aeba449b-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Flow 'volume_create_manager' (2527171f-457e-4513-9300-a9c5879ac42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef621cdd-8578-4031-84c4-130e450accff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef621cdd-8578-4031-84c4-130e450accff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1782808484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d87728-07c3-45c5-94a2-546188974da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06df6011782043d4a54cc60033bea3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:55Z,use_quota=True,user_id='826dda89b34744178e7a29b0f244cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b3d92e-cafa-4441-a5c1-f301562db17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b3d92e-cafa-4441-a5c1-f301562db17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddad7aea-4cdd-4427-8dc8-8607ae9def40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddad7aea-4cdd-4427-8dc8-8607ae9def40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53d87728-07c3-45c5-94a2-546188974da4', 'volume_name': 'volume-53d87728-07c3-45c5-94a2-546188974da4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9a156f-7df8-4de8-aa35-7683da8d98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9a156f-7df8-4de8-aa35-7683da8d98eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bb4731-357f-4075-8565-d968e9658f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:54 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Volume 53d87728-07c3-45c5-94a2-546188974da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53d87728-07c3-45c5-94a2-546188974da4', 'volume_size': 1} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1782808484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53d87728-07c3-45c5-94a2-546188974da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06df6011782043d4a54cc60033bea3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:55Z,use_quota=True,user_id='826dda89b34744178e7a29b0f244cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Creating volume 53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:54 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:19:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:54 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 1073741824 Sep 01 02:19:54 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:55 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 1073741824" returned: 0 in 0.565s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:55 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 Sep 01 02:19:55 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:55 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4" returned: 0 in 0.308s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60bb4731-357f-4075-8565-d968e9658f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53d87728-07c3-45c5-94a2-546188974da4', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ed3d30-6d54-4c3e-8fc0-869b11b17cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:55 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Volume volume-53d87728-07c3-45c5-94a2-546188974da4 (53d87728-07c3-45c5-94a2-546188974da4): created successfully Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ed3d30-6d54-4c3e-8fc0-869b11b17cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Flow 'volume_create_manager' (2527171f-457e-4513-9300-a9c5879ac42e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b32576e9-7492-47f2-aebf-e314b4491b15 tempest-TestStampPattern-1374263888 None] Created volume successfully. Sep 01 02:20:05 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:05 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:06 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:20:06 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:06 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.350s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:20:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Flow 'volume_create_manager' (55b5a071-b43f-4ab0-83ff-b4a26905515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc3cd8d-ba29-46f3-a55d-3efb64e03c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebc3cd8d-ba29-46f3-a55d-3efb64e03c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1050792968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b72e0d4-09c2-4b36-af67-81f3f801a079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70bfc2801cc4d48b25cce721986faae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:19Z,use_quota=True,user_id='341b24ca22794b619d655b1a49a745e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5aa55c7-7191-400e-bbcd-4404a0043864),volume_type_id=c5aa55c7-7191-400e-bbcd-4404a0043864)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c0392b-d645-4c82-b4eb-24d8894d1d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c0392b-d645-4c82-b4eb-24d8894d1d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792dc036-e6c9-445c-907c-c839907701f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792dc036-e6c9-445c-907c-c839907701f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b72e0d4-09c2-4b36-af67-81f3f801a079', 'volume_name': 'volume-9b72e0d4-09c2-4b36-af67-81f3f801a079', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d803a4c-962a-4509-9d97-d4c7d3a5c59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d803a4c-962a-4509-9d97-d4c7d3a5c59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f95e25-6c51-4f4d-9eab-2fd5d566afdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:18 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume 9b72e0d4-09c2-4b36-af67-81f3f801a079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b72e0d4-09c2-4b36-af67-81f3f801a079', 'volume_size': 1} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1050792968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b72e0d4-09c2-4b36-af67-81f3f801a079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70bfc2801cc4d48b25cce721986faae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:19Z,use_quota=True,user_id='341b24ca22794b619d655b1a49a745e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5aa55c7-7191-400e-bbcd-4404a0043864),volume_type_id=c5aa55c7-7191-400e-bbcd-4404a0043864)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Creating volume 9b72e0d4-09c2-4b36-af67-81f3f801a079 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:18 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:18 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 1073741824 Sep 01 02:20:18 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:18 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Flow 'volume_create_manager' (75b7c369-7d90-4c03-a646-0c056ee368c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7c809c-c244-4806-811c-7ef6e3ce19cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7c809c-c244-4806-811c-7ef6e3ce19cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-737947670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854a3bbd-beee-4c3f-ba57-a19543524b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70bfc2801cc4d48b25cce721986faae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:19Z,use_quota=True,user_id='341b24ca22794b619d655b1a49a745e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79ea1126-784e-4125-9b5b-ecfb450fdc8d),volume_type_id=79ea1126-784e-4125-9b5b-ecfb450fdc8d)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71a3a35-299a-4325-be67-f1c4bcf67560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71a3a35-299a-4325-be67-f1c4bcf67560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69533762-aa0c-487c-9db2-e7443fbe29f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69533762-aa0c-487c-9db2-e7443fbe29f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '854a3bbd-beee-4c3f-ba57-a19543524b52', 'volume_name': 'volume-854a3bbd-beee-4c3f-ba57-a19543524b52', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ade5ac1-3db0-4c13-b0e2-ce0f0a49f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ade5ac1-3db0-4c13-b0e2-ce0f0a49f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde30648-373f-4795-8f4d-711e35b44ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume 854a3bbd-beee-4c3f-ba57-a19543524b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-854a3bbd-beee-4c3f-ba57-a19543524b52', 'volume_size': 1} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:19 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 1073741824" returned: 0 in 0.494s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:19 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 Sep 01 02:20:19 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:19 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079" returned: 0 in 0.285s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-737947670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854a3bbd-beee-4c3f-ba57-a19543524b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70bfc2801cc4d48b25cce721986faae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:19Z,use_quota=True,user_id='341b24ca22794b619d655b1a49a745e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(79ea1126-784e-4125-9b5b-ecfb450fdc8d),volume_type_id=79ea1126-784e-4125-9b5b-ecfb450fdc8d)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Creating volume 854a3bbd-beee-4c3f-ba57-a19543524b52 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:19 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:19 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 1073741824 Sep 01 02:20:19 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f95e25-6c51-4f4d-9eab-2fd5d566afdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b72e0d4-09c2-4b36-af67-81f3f801a079', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2bda02-f1b5-4eb9-8fe4-52f7232ed3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 (9b72e0d4-09c2-4b36-af67-81f3f801a079): created successfully Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2bda02-f1b5-4eb9-8fe4-52f7232ed3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Flow 'volume_create_manager' (55b5a071-b43f-4ab0-83ff-b4a26905515c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-293aac12-c28c-4950-946c-f88d9d82af8c tempest-TestInstancesWithCinderVolumes-1633510051 None] Created volume successfully. Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Flow 'volume_create_manager' (6381f68f-d6b7-4dc4-9c8a-aefc74d08492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86adc543-6da8-43ea-9b45-5172b2e415d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86adc543-6da8-43ea-9b45-5172b2e415d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1240490473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70bfc2801cc4d48b25cce721986faae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:20Z,use_quota=True,user_id='341b24ca22794b619d655b1a49a745e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ade99fb8-a916-49a4-9a1c-bb1b2b78a918),volume_type_id=ade99fb8-a916-49a4-9a1c-bb1b2b78a918)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3089a4f1-e231-4816-ab6c-0ad68a01330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3089a4f1-e231-4816-ab6c-0ad68a01330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfa9ce6-df7e-4626-a07c-a2dbb77871dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfa9ce6-df7e-4626-a07c-a2dbb77871dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f', 'volume_name': 'volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f', 'volume_size': 1, 'image_id': '48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1548751161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd70bfc2801cc4d48b25cce721986faae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad/file', 'properties': {}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f6c504-e4bd-4e7b-82da-e2b027331292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f6c504-e4bd-4e7b-82da-e2b027331292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4b606d-6188-47a5-9c9e-e49bccd894f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f', 'volume_size': 1, 'image_id': '48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1548751161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd70bfc2801cc4d48b25cce721986faae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad/file', 'properties': {}}, 'image_service': } Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Trying to clone f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f from image 48c812d7-65fc-4f3e-96d8-8fe64c9898ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:20:20 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 1073741824" returned: 0 in 0.489s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:20 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 Sep 01 02:20:20 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:20 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52" returned: 0 in 0.271s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde30648-373f-4795-8f4d-711e35b44ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-854a3bbd-beee-4c3f-ba57-a19543524b52', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8189fc-5398-4980-8cc6-b6ee9a9011b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:20 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume volume-854a3bbd-beee-4c3f-ba57-a19543524b52 (854a3bbd-beee-4c3f-ba57-a19543524b52): created successfully Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8189fc-5398-4980-8cc6-b6ee9a9011b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:20 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Flow 'volume_create_manager' (75b7c369-7d90-4c03-a646-0c056ee368c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e42c0e58-9fb9-4b65-8726-e9ccc1a268e3 tempest-TestInstancesWithCinderVolumes-1633510051 None] Created volume successfully. Sep 01 02:20:23 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD, size 20.69 MB, duration 3.24 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:20:23 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Image download 20.69 MB at 6.38 MB/s Sep 01 02:20:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6f32bb-d587-4abb-9b79-e6d8ba44ccdf]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD Sep 01 02:20:23 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:23 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:23 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Temporary image 48c812d7-65fc-4f3e-96d8-8fe64c9898ad is fetched for user 341b24ca22794b619d655b1a49a745e2. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:20:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e58a17-50ae-4fbd-a074-33cf5ac171c6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:23 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD Sep 01 02:20:23 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1240490473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70bfc2801cc4d48b25cce721986faae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:20Z,use_quota=True,user_id='341b24ca22794b619d655b1a49a745e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ade99fb8-a916-49a4-9a1c-bb1b2b78a918),volume_type_id=ade99fb8-a916-49a4-9a1c-bb1b2b78a918)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Creating volume f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:24 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:24 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f 1073741824 Sep 01 02:20:24 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f 1073741824" returned: 0 in 0.475s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:24 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f Sep 01 02:20:24 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:24 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f" returned: 0 in 0.280s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Attempting download of 48c812d7-65fc-4f3e-96d8-8fe64c9898ad ((None, [{'url': 'file:///opt/stack/data/glance/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'metadata': {}}])) to volume f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e43e4d-d9b8-47e7-be45-d7485cab3fc8]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_vtahsou4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_vtahsou4 Sep 01 02:20:25 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_vtahsou4" returned: 0 in 0.340s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_vtahsou4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_vtahsou4 Sep 01 02:20:25 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_vtahsou4" returned: 1 in 0.348s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_vtahsou4' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:20:25 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d4d53-3c12-45a7-8aaf-63bcc16abbb9]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:25 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD Sep 01 02:20:25 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:25 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:26 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] 48c812d7-65fc-4f3e-96d8-8fe64c9898ad was qcow2, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:20:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:26 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f Sep 01 02:20:26 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-5ec04389-a557-49a8-971c-9a71d130d6cb req-3dd326d9-7cf4-45f2-8b2e-5b2e9c3d41c2 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-5ec04389-a557-49a8-971c-9a71d130d6cb req-3dd326d9-7cf4-45f2-8b2e-5b2e9c3d41c2 tempest-TestStampPattern-1374263888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-5ec04389-a557-49a8-971c-9a71d130d6cb req-3dd326d9-7cf4-45f2-8b2e-5b2e9c3d41c2 tempest-TestStampPattern-1374263888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-5ec04389-a557-49a8-971c-9a71d130d6cb req-3dd326d9-7cf4-45f2-8b2e-5b2e9c3d41c2 tempest-TestStampPattern-1374263888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-53d87728-07c3-45c5-94a2-546188974da4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7492f32e-eb14-4de5-b0a9-bf0caa2e332e', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:20:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-5ec04389-a557-49a8-971c-9a71d130d6cb req-3dd326d9-7cf4-45f2-8b2e-5b2e9c3d41c2 tempest-TestStampPattern-1374263888 None] attachment_update completed successfully. Sep 01 02:20:27 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f" returned: 0 in 1.903s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:27 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_48c812d7-65fc-4f3e-96d8-8fe64c9898ad_8bvot7oddevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:20:27 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Converted 112.00 MB image at 58.81 MB/s Sep 01 02:20:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:27 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f 1G Sep 01 02:20:27 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:28 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f 1G" returned: 0 in 0.320s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Downloaded image 48c812d7-65fc-4f3e-96d8-8fe64c9898ad ((None, [{'url': 'file:///opt/stack/data/glance/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'metadata': {}}])) to volume f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Temporary image 48c812d7-65fc-4f3e-96d8-8fe64c9898ad for user 341b24ca22794b619d655b1a49a745e2 is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Marking volume f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Copying metadata from image 48c812d7-65fc-4f3e-96d8-8fe64c9898ad to f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Creating volume glance metadata for volume f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f backed by image 48c812d7-65fc-4f3e-96d8-8fe64c9898ad with: {'image_id': '48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'image_name': 'tempest-scenario-img--1548751161', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4b606d-6188-47a5-9c9e-e49bccd894f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f', 'volume_size': 1, 'image_id': '48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1548751161', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd70bfc2801cc4d48b25cce721986faae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '48c812d7-65fc-4f3e-96d8-8fe64c9898ad', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48c812d7-65fc-4f3e-96d8-8fe64c9898ad/file', 'properties': {}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41ea2d1-5109-4568-83a3-ef3263d04250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:28 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Volume volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f (f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f): created successfully Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41ea2d1-5109-4568-83a3-ef3263d04250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Flow 'volume_create_manager' (6381f68f-d6b7-4dc4-9c8a-aefc74d08492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:28 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e7def8ec-5a92-4e6f-93b9-de03a617c62a tempest-TestInstancesWithCinderVolumes-1633510051 None] Created volume successfully. Sep 01 02:20:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-17bda611-8054-41e2-afba-aae0300577d1 req-5b154a08-8de2-4c68-817d-03e22b3b5f94 tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-17bda611-8054-41e2-afba-aae0300577d1 req-5b154a08-8de2-4c68-817d-03e22b3b5f94 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-17bda611-8054-41e2-afba-aae0300577d1 req-5b154a08-8de2-4c68-817d-03e22b3b5f94 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-17bda611-8054-41e2-afba-aae0300577d1 req-5b154a08-8de2-4c68-817d-03e22b3b5f94 tempest-TestInstancesWithCinderVolumes-1633510051 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29ee877b-80d7-495c-ab7a-3d4e2da73c0e', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:20:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-17bda611-8054-41e2-afba-aae0300577d1 req-5b154a08-8de2-4c68-817d-03e22b3b5f94 tempest-TestInstancesWithCinderVolumes-1633510051 None] attachment_update completed successfully. Sep 01 02:20:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-0e3e71b4-e26e-4bc0-af33-2b4edbc1f1c5 req-83ebd20d-c8e3-43e8-8039-2411ad45f7a2 tempest-TestStampPattern-1374263888 None] Terminate volume connection completed successfully. Sep 01 02:20:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-0e3e71b4-e26e-4bc0-af33-2b4edbc1f1c5 req-83ebd20d-c8e3-43e8-8039-2411ad45f7a2 tempest-TestStampPattern-1374263888 None] Deleting attachment 7492f32e-eb14-4de5-b0a9-bf0caa2e332e. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:20:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Creating offline snapshot b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf of volume 53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:20:33 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f83d07-b937-4552-b9d6-d1ad4a04d11f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:33 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 Sep 01 02:20:33 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:34 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4" returned: 0 in 0.472s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:34 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf 1G Sep 01 02:20:34 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:34 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf 1G" returned: 0 in 0.668s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53d87728-07c3-45c5-94a2-546188974da4 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:35 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53d87728-07c3-45c5-94a2-546188974da4 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf Sep 01 02:20:35 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:35 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53d87728-07c3-45c5-94a2-546188974da4 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" returned: 0 in 0.540s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:35 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf is being set with open permissions: ugo+rw Sep 01 02:20:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:35 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf Sep 01 02:20:35 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:35 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" returned: 0 in 0.400s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:35 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.info Sep 01 02:20:35 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:36 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.info" returned: 0 in 0.303s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:36 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.info is being set with open permissions: ugo+rw Sep 01 02:20:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:36 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.info Sep 01 02:20:36 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:36 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.info" returned: 0 in 0.358s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.894s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cad7e7ba-d199-4ec5-bc30-7ab4f5acf276 tempest-TestStampPattern-1374263888 None] Create snapshot completed successfully Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Flow 'volume_create_manager' (672ef04c-26ec-447b-a15a-19535f273c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0adbef-fcad-41bd-909d-1acb9125568b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0adbef-fcad-41bd-909d-1acb9125568b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-335606810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b096f8a-e4e1-4fba-ac43-03f354c09e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06df6011782043d4a54cc60033bea3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:45Z,use_quota=True,user_id='826dda89b34744178e7a29b0f244cf5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c7d54c-4ba5-4aeb-9eee-18672a9fd9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c7d54c-4ba5-4aeb-9eee-18672a9fd9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea005d9-09fa-41d4-89ae-784bb9d02834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea005d9-09fa-41d4-89ae-784bb9d02834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b096f8a-e4e1-4fba-ac43-03f354c09e4d', 'volume_name': 'volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d', 'volume_size': 1, 'snapshot_id': 'b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8b1f7b-66a0-4da9-8a95-62d556ebeb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c8b1f7b-66a0-4da9-8a95-62d556ebeb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fa46b9-1fbe-4ca7-9d02-06170ccda1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:45 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Volume 3b096f8a-e4e1-4fba-ac43-03f354c09e4d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d', 'volume_size': 1, 'snapshot_id': 'b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf'} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-quobyte-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Creating volume 3b096f8a-e4e1-4fba-ac43-03f354c09e4d from snapshot b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-quobyte-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] snapshot: b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf, volume: 3b096f8a-e4e1-4fba-ac43-03f354c09e4d, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9938770-14a1-4790-a37c-d757db618693]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:45 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf Sep 01 02:20:45 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" returned: 0 in 0.495s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53d87728-07c3-45c5-94a2-546188974da4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[73729732-4c02-4c43-bd30-d9ed7b56c1e5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 Sep 01 02:20:46 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:46 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4" returned: 0 in 0.492s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:20:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:46 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d Sep 01 02:20:46 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:53 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" returned: 0 in 7.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:53 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4, size 1024.00 MB, duration 7.26 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:20:53 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Converted 1024.00 MB image at 141.11 MB/s Sep 01 02:20:53 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d is being set with open permissions: ugo+rw Sep 01 02:20:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:54 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d Sep 01 02:20:54 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:54 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" returned: 0 in 0.434s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" released by "_copy_volume_from_snapshot" :: held 8.798s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" released by "_create_volume_from_snapshot" :: held 8.913s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.934s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fa46b9-1fbe-4ca7-9d02-06170ccda1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d', 'volume_size': 1, 'snapshot_id': 'b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40f7bc6-2bb2-4845-8940-977080a82774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:54 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Volume volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d (3b096f8a-e4e1-4fba-ac43-03f354c09e4d): created successfully Sep 01 02:20:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40f7bc6-2bb2-4845-8940-977080a82774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Flow 'volume_create_manager' (672ef04c-26ec-447b-a15a-19535f273c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:54 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-660a8d2a-278f-4e20-a9c3-95b5fa9f8128 tempest-TestStampPattern-1374263888 None] Created volume successfully. Sep 01 02:21:04 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=32,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=3 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:04 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=23,cinder:SELECT=33,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-c00cc5c3-8146-4a0f-be7c-76adbc685d05 req-26e1f219-4844-4d60-8d68-79e78ae5b985 tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-c00cc5c3-8146-4a0f-be7c-76adbc685d05 req-26e1f219-4844-4d60-8d68-79e78ae5b985 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-c00cc5c3-8146-4a0f-be7c-76adbc685d05 req-26e1f219-4844-4d60-8d68-79e78ae5b985 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-c00cc5c3-8146-4a0f-be7c-76adbc685d05 req-26e1f219-4844-4d60-8d68-79e78ae5b985 tempest-TestInstancesWithCinderVolumes-1633510051 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-9b72e0d4-09c2-4b36-af67-81f3f801a079', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ab23f6ce-f819-45cb-83a5-c80dc32872db', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:21:05 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-c00cc5c3-8146-4a0f-be7c-76adbc685d05 req-26e1f219-4844-4d60-8d68-79e78ae5b985 tempest-TestInstancesWithCinderVolumes-1633510051 None] attachment_update completed successfully. Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:06 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:21:06 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:06 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.361s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:21:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:21:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-9e4f30bc-e29e-45fb-90ca-8537341a3a19 req-4e488838-f058-48b7-b140-6986b112c106 tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-9e4f30bc-e29e-45fb-90ca-8537341a3a19 req-4e488838-f058-48b7-b140-6986b112c106 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-9e4f30bc-e29e-45fb-90ca-8537341a3a19 req-4e488838-f058-48b7-b140-6986b112c106 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-9e4f30bc-e29e-45fb-90ca-8537341a3a19 req-4e488838-f058-48b7-b140-6986b112c106 tempest-TestInstancesWithCinderVolumes-1633510051 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-854a3bbd-beee-4c3f-ba57-a19543524b52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '455f6d7d-a390-4fdf-a9a5-9cc214f45a09', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:21:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-9e4f30bc-e29e-45fb-90ca-8537341a3a19 req-4e488838-f058-48b7-b140-6986b112c106 tempest-TestInstancesWithCinderVolumes-1633510051 None] attachment_update completed successfully. Sep 01 02:21:12 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-af9f8eee-4a0c-4994-b64c-ae060ec7280c req-8458488f-724b-4c08-8f91-e302eebf61bc tempest-TestInstancesWithCinderVolumes-1633510051 None] Terminate volume connection completed successfully. Sep 01 02:21:12 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-af9f8eee-4a0c-4994-b64c-ae060ec7280c req-8458488f-724b-4c08-8f91-e302eebf61bc tempest-TestInstancesWithCinderVolumes-1633510051 None] Deleting attachment ab23f6ce-f819-45cb-83a5-c80dc32872db. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:21:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "cinder-9b72e0d4-09c2-4b36-af67-81f3f801a079-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-9b72e0d4-09c2-4b36-af67-81f3f801a079-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "cinder-quobyte-9b72e0d4-09c2-4b36-af67-81f3f801a079" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-quobyte-9b72e0d4-09c2-4b36-af67-81f3f801a079" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:13 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[753f4da1-2323-4be9-9ec6-df1ac94f3cce]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:13 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 Sep 01 02:21:13 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:13 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079" returned: 0 in 0.420s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:13 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079 Sep 01 02:21:13 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:14 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-9b72e0d4-09c2-4b36-af67-81f3f801a079" returned: 0 in 0.280s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-quobyte-9b72e0d4-09c2-4b36-af67-81f3f801a079" released by "delete_volume" :: held 0.753s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:14 devstack cinder-volume[87425]: WARNING cinder.quota [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1589658306-730430813 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1589658306-730430813, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:21:14 devstack cinder-volume[87425]: WARNING cinder.quota [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1589658306-730430813 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1589658306-730430813, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Created reservations ['6996cbd9-35f9-414b-aca4-0342711ebfca', '94f499e9-debc-411c-b89a-0126350c4dc5', '0df58f30-fa85-4e63-8c2f-2aebb134a5e7', '2e620a12-7988-4bac-a0aa-5f5eff9d096b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:14 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:21:14 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:14 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.264s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Deleted volume successfully. Sep 01 02:21:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2f9d123c-dee8-4867-8fcd-b27feb52887c tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-9b72e0d4-09c2-4b36-af67-81f3f801a079-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-88a3d450-5b31-4465-b4a1-806678ae1368 req-ae338349-592b-4280-add5-8f707f594ec7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Terminate volume connection completed successfully. Sep 01 02:21:16 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-88a3d450-5b31-4465-b4a1-806678ae1368 req-ae338349-592b-4280-add5-8f707f594ec7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Deleting attachment 455f6d7d-a390-4fdf-a9a5-9cc214f45a09. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:21:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "cinder-854a3bbd-beee-4c3f-ba57-a19543524b52-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-854a3bbd-beee-4c3f-ba57-a19543524b52-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "cinder-quobyte-854a3bbd-beee-4c3f-ba57-a19543524b52" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-quobyte-854a3bbd-beee-4c3f-ba57-a19543524b52" acquired by "delete_volume" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:17 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dbbfab-7177-4404-8663-ec50c0b14127]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:17 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 Sep 01 02:21:17 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:18 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52" returned: 0 in 0.415s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:18 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52 Sep 01 02:21:18 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:18 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-854a3bbd-beee-4c3f-ba57-a19543524b52" returned: 0 in 0.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-quobyte-854a3bbd-beee-4c3f-ba57-a19543524b52" released by "delete_volume" :: held 0.719s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:18 devstack cinder-volume[87425]: WARNING cinder.quota [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-36565657-1992773426 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-36565657-1992773426, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:21:18 devstack cinder-volume[87425]: WARNING cinder.quota [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-36565657-1992773426 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-36565657-1992773426, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Created reservations ['aa5a0b65-5da4-4424-a26c-033090980953', 'd8fe9553-479e-40a1-845b-388392ebfe6f', '5314b1b1-7043-4b3c-a979-29e6f084eb4f', 'd64e99c6-feff-430e-b96f-5c4fbc56a18f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:18 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:21:18 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:18 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.291s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:18 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Deleted volume successfully. Sep 01 02:21:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-232342c5-c09f-4b45-8a98-50873039c4f7 tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-854a3bbd-beee-4c3f-ba57-a19543524b52-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-72eb1d1a-2753-4691-91a3-2c3e899a4573 req-eed95e71-ee5d-4f28-8a8d-b0cbffcac7fa tempest-TestInstancesWithCinderVolumes-1633510051 None] Terminate volume connection completed successfully. Sep 01 02:21:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-72eb1d1a-2753-4691-91a3-2c3e899a4573 req-eed95e71-ee5d-4f28-8a8d-b0cbffcac7fa tempest-TestInstancesWithCinderVolumes-1633510051 None] Deleting attachment 29ee877b-80d7-495c-ab7a-3d4e2da73c0e. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "cinder-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "cinder-quobyte-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-quobyte-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[33111f34-f34f-4f0c-833c-884c8c48ec6c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:23 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f Sep 01 02:21:23 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:23 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f" returned: 0 in 0.427s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:23 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f Sep 01 02:21:23 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:23 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f" returned: 0 in 0.260s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-quobyte-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f" released by "delete_volume" :: held 0.735s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:23 devstack cinder-volume[87425]: WARNING cinder.quota [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583185427-245448688 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583185427-245448688, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:21:23 devstack cinder-volume[87425]: WARNING cinder.quota [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583185427-245448688 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1583185427-245448688, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:21:23 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Created reservations ['395c1972-f3df-4795-8648-217ee10f1646', '58edbf79-9971-416c-9e3e-ba52ca9c9cff', '1bd431f4-c78d-47c2-a420-2ca6cad6d37c', '24d80803-e62d-408d-b62d-2f7801382b13'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:24 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:21:24 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:24 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.294s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Deleted volume successfully. Sep 01 02:21:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-28c1184f-2166-4897-9c3f-6e69056a670f tempest-TestInstancesWithCinderVolumes-1633510051 None] Lock "cinder-f0bd1846-23f5-4d6a-8721-ca0d5b3c9a5f-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-35f111dc-50cd-492a-9ac8-0adf01815b84 req-116bc397-e5ca-4c07-93a7-bdec03bb46f1 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-35f111dc-50cd-492a-9ac8-0adf01815b84 req-116bc397-e5ca-4c07-93a7-bdec03bb46f1 tempest-TestStampPattern-1374263888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [req-35f111dc-50cd-492a-9ac8-0adf01815b84 req-116bc397-e5ca-4c07-93a7-bdec03bb46f1 tempest-TestStampPattern-1374263888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-35f111dc-50cd-492a-9ac8-0adf01815b84 req-116bc397-e5ca-4c07-93a7-bdec03bb46f1 tempest-TestStampPattern-1374263888 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7', 'name': 'volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8211bda-2f04-4d45-97a9-4da5c53fa340', 'enforce_multipath': True} {{(pid=87425) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:21:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-35f111dc-50cd-492a-9ac8-0adf01815b84 req-116bc397-e5ca-4c07-93a7-bdec03bb46f1 tempest-TestStampPattern-1374263888 None] attachment_update completed successfully. Sep 01 02:21:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [req-f43c873f-2afc-417b-8164-e5acd0b1ca97 req-219795ec-6a3b-411a-a12e-dccdb7c25e47 tempest-TestStampPattern-1374263888 None] Terminate volume connection completed successfully. Sep 01 02:21:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [req-f43c873f-2afc-417b-8164-e5acd0b1ca97 req-219795ec-6a3b-411a-a12e-dccdb7c25e47 tempest-TestStampPattern-1374263888 None] Deleting attachment c8211bda-2f04-4d45-97a9-4da5c53fa340. {{(pid=87425) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-3b096f8a-e4e1-4fba-ac43-03f354c09e4d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Lock "cinder-3b096f8a-e4e1-4fba-ac43-03f354c09e4d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-quobyte-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d55823-886d-43ee-85d8-ed923b016c13]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:36 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d Sep 01 02:21:36 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:36 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" returned: 0 in 0.405s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:36 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d Sep 01 02:21:36 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:36 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" returned: 0 in 0.329s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-3b096f8a-e4e1-4fba-ac43-03f354c09e4d" released by "delete_volume" :: held 0.780s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Created reservations ['030a4cc4-603a-4154-962c-68645d3268b8', '677ea443-8d60-4642-ab1a-ecce95e761aa', '420c8c5d-08e4-474f-b47c-5bace7277114', '12601ea3-ad63-4304-8e30-bb3f4f7d035f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:37 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:21:37 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:37 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Deleted volume successfully. Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-adae8619-90ee-4f97-901c-06ab4afce026 tempest-TestStampPattern-1374263888 None] Lock "cinder-3b096f8a-e4e1-4fba-ac43-03f354c09e4d-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Lock "cinder-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-quobyte-53d87728-07c3-45c5-94a2-546188974da4" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-53d87728-07c3-45c5-94a2-546188974da4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-quobyte-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Deleting offline snapshot b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf of volume 53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] snapshot_file for this snap is: volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef1eefb-8fdb-4173-b040-1480e45332ee]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:37 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf Sep 01 02:21:37 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:38 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" returned: 0 in 0.397s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53d87728-07c3-45c5-94a2-546188974da4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccf59c6-f827-4e53-9c3d-58a07fb5c9c4]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:38 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 Sep 01 02:21:38 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Flow 'volume_create_manager' (4c3240fa-7dc5-479c-bef0-d2831082a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c61e14-af3b-4fd8-a3bb-7719b17a51ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c61e14-af3b-4fd8-a3bb-7719b17a51ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1831017331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3514a6d-16ee-4d73-a6ec-caddf179f2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e0159af0640149ccaf5872aecc7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:38Z,use_quota=True,user_id='949da973d7e94e719adc401a4c01f386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a728e6f-e859-41fe-87e8-766008343186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a728e6f-e859-41fe-87e8-766008343186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33842879-92b3-409a-b37f-0fcf10a543b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33842879-92b3-409a-b37f-0fcf10a543b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3514a6d-16ee-4d73-a6ec-caddf179f2a9', 'volume_name': 'volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98bd595-d970-42d7-b98c-b62187aeacca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98bd595-d970-42d7-b98c-b62187aeacca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1efe560-afd4-43d1-b498-713aefc6772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:38 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Volume a3514a6d-16ee-4d73-a6ec-caddf179f2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9', 'volume_size': 1} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1831017331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3514a6d-16ee-4d73-a6ec-caddf179f2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e0159af0640149ccaf5872aecc7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:38Z,use_quota=True,user_id='949da973d7e94e719adc401a4c01f386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Creating volume a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:38 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:38 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 1073741824 Sep 01 02:21:38 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:38 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4" returned: 0 in 0.590s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:38 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf Sep 01 02:21:38 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:38 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 1073741824" returned: 0 in 0.432s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:39 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 Sep 01 02:21:39 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:39 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" returned: 0 in 0.355s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:39 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf Sep 01 02:21:39 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:39 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" returned: 0 in 0.281s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1efe560-afd4-43d1-b498-713aefc6772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b934b3-86cb-4305-b9af-dd011338a055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Volume volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 (a3514a6d-16ee-4d73-a6ec-caddf179f2a9): created successfully Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b934b3-86cb-4305-b9af-dd011338a055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Flow 'volume_create_manager' (4c3240fa-7dc5-479c-bef0-d2831082a860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:39 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-476cf2a8-0dd1-4dea-a6ab-02af7bcf877f tempest-VolumeDependencyTests-789017440 None] Created volume successfully. Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4.b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" returned: 0 in 0.275s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf" released by "_delete_snapshot" :: held 1.726s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-53d87728-07c3-45c5-94a2-546188974da4" released by "delete_snapshot" :: held 1.753s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Created reservations ['a8d98e91-d9c4-4ea0-ba67-c2abf84e3317', 'd0806f07-1ddf-4948-af96-45884636a289', '92556600-6423-4dcf-9d0e-daf616581171', 'ea0cc5aa-c97b-44f4-bb7b-c72ae1140685'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Delete snapshot completed successfully. Sep 01 02:21:39 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-2c13b059-d58d-48f9-8e67-0ea85df2c46d tempest-TestStampPattern-1374263888 None] Lock "cinder-b1b1e9c4-ab51-4a25-bab8-e0e684e23fcf-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Creating offline snapshot 44569c7a-f688-4b13-8f9d-9e80ffa08104 of volume a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:40 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[869d421c-7245-401f-a41d-3aaf51dfc825]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:41 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 Sep 01 02:21:41 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:41 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" returned: 0 in 0.538s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:41 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 1G Sep 01 02:21:41 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:41 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 1G" returned: 0 in 0.508s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:41 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 Sep 01 02:21:42 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:42 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104" returned: 0 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 is being set with open permissions: ugo+rw Sep 01 02:21:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 Sep 01 02:21:42 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:42 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104" returned: 0 in 0.268s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.info Sep 01 02:21:42 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:42 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.info" returned: 0 in 0.279s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.info is being set with open permissions: ugo+rw Sep 01 02:21:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.info Sep 01 02:21:42 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:43 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.info" returned: 0 in 0.269s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a6adf785-c04e-438b-a626-6796b0e0e6ca tempest-VolumeDependencyTests-789017440 None] Create snapshot completed successfully Sep 01 02:21:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-53d87728-07c3-45c5-94a2-546188974da4-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Lock "cinder-53d87728-07c3-45c5-94a2-546188974da4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Acquiring lock "cinder-quobyte-53d87728-07c3-45c5-94a2-546188974da4" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-53d87728-07c3-45c5-94a2-546188974da4" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0f07b4-3c5b-4c52-bd16-5d89b325eef7]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:43 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 Sep 01 02:21:43 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4" returned: 0 in 0.400s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4 Sep 01 02:21:44 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-53d87728-07c3-45c5-94a2-546188974da4" returned: 0 in 0.274s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Lock "cinder-quobyte-53d87728-07c3-45c5-94a2-546188974da4" released by "delete_volume" :: held 0.744s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Created reservations ['fe7bbd16-d766-4843-8a6c-8f3350303c08', 'cab9d873-7bec-4394-a271-c070a0439e60', 'fc6821fa-e43d-4414-ab07-9593e7080b2e', 'a060a1ae-d8c1-4a45-9193-584ea23dcfa8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:21:44 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Flow 'volume_create_manager' (6d631e33-d5f8-4157-a605-c09c87a3ed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c810f9-1d12-48ea-a3f3-7e42bef5a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c810f9-1d12-48ea-a3f3-7e42bef5a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1376075029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c8cff9-ff2b-465a-80e5-23aa80e892d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='999e0159af0640149ccaf5872aecc7da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44569c7a-f688-4b13-8f9d-9e80ffa08104,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:45Z,use_quota=True,user_id='949da973d7e94e719adc401a4c01f386',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f44f08-b8c3-463f-abe8-c79a32c85660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f44f08-b8c3-463f-abe8-c79a32c85660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a4b9ad-b570-4c42-8266-47779134ce99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a4b9ad-b570-4c42-8266-47779134ce99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7c8cff9-ff2b-465a-80e5-23aa80e892d1', 'volume_name': 'volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1', 'volume_size': 1, 'snapshot_id': '44569c7a-f688-4b13-8f9d-9e80ffa08104'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea679ba-9890-42a8-94f2-212bd906f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cea679ba-9890-42a8-94f2-212bd906f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584a82bb-f050-4661-ab97-3beaf9094300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Volume e7c8cff9-ff2b-465a-80e5-23aa80e892d1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1', 'volume_size': 1, 'snapshot_id': '44569c7a-f688-4b13-8f9d-9e80ffa08104'} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-quobyte-44569c7a-f688-4b13-8f9d-9e80ffa08104-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-44569c7a-f688-4b13-8f9d-9e80ffa08104-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Creating volume e7c8cff9-ff2b-465a-80e5-23aa80e892d1 from snapshot 44569c7a-f688-4b13-8f9d-9e80ffa08104 {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-quobyte-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:44 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.295s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] snapshot: 44569c7a-f688-4b13-8f9d-9e80ffa08104, volume: e7c8cff9-ff2b-465a-80e5-23aa80e892d1, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:21:44 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Deleted volume successfully. Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-afa35ed5-ee99-4c31-9264-0fdd0d480fd7 tempest-TestStampPattern-1374263888 None] Lock "cinder-53d87728-07c3-45c5-94a2-546188974da4-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[beee9ca3-9175-4c3d-9457-094f0bdc22c6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 Sep 01 02:21:44 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:45 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104" returned: 0 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0d45a-eea4-42bf-a43c-e73e7eb71d1c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:45 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 Sep 01 02:21:45 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:45 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" returned: 0 in 0.395s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:21:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:45 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 Sep 01 02:21:45 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:50 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" returned: 0 in 4.897s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:21:50 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Converted 1024.00 MB image at 209.05 MB/s Sep 01 02:21:50 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 is being set with open permissions: ugo+rw Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:50 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 Sep 01 02:21:50 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:50 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" returned: 0 in 0.299s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" released by "_copy_volume_from_snapshot" :: held 6.117s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-44569c7a-f688-4b13-8f9d-9e80ffa08104-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" released by "_create_volume_from_snapshot" :: held 6.192s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.211s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584a82bb-f050-4661-ab97-3beaf9094300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1', 'volume_size': 1, 'snapshot_id': '44569c7a-f688-4b13-8f9d-9e80ffa08104'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e871c0e-dc87-4c46-8732-051e4fa2c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:50 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Volume volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 (e7c8cff9-ff2b-465a-80e5-23aa80e892d1): created successfully Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e871c0e-dc87-4c46-8732-051e4fa2c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Flow 'volume_create_manager' (6d631e33-d5f8-4157-a605-c09c87a3ed95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:51 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6687f563-bbae-4a30-8dd1-459cb74e12cf tempest-VolumeDependencyTests-789017440 None] Created volume successfully. Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-44569c7a-f688-4b13-8f9d-9e80ffa08104-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-44569c7a-f688-4b13-8f9d-9e80ffa08104-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-quobyte-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-quobyte-44569c7a-f688-4b13-8f9d-9e80ffa08104" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-44569c7a-f688-4b13-8f9d-9e80ffa08104" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Deleting offline snapshot 44569c7a-f688-4b13-8f9d-9e80ffa08104 of volume a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] snapshot_file for this snap is: volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82b94e7-8eae-4690-a347-2fe96ec8178e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:51 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 Sep 01 02:21:51 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104" returned: 0 in 0.429s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:52 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8464a0c2-31a4-4104-9d8c-9e2848558b87]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 Sep 01 02:21:52 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" returned: 0 in 0.596s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 Sep 01 02:21:52 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104 Sep 01 02:21:53 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9.44569c7a-f688-4b13-8f9d-9e80ffa08104" returned: 0 in 0.265s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-44569c7a-f688-4b13-8f9d-9e80ffa08104" released by "_delete_snapshot" :: held 1.771s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" released by "delete_snapshot" :: held 1.795s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Created reservations ['35a2d8c5-7144-408f-87be-6d68391769c2', 'b8ba1488-e78c-4902-b29d-1d1135e787c9', '1662f280-fe7a-451d-8522-961c157fc5cb', '4ccc1d80-1efa-4d2d-836f-84c001300fdd'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:53 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Delete snapshot completed successfully. Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5793f055-ac73-4ad1-80d4-d94d69221622 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-44569c7a-f688-4b13-8f9d-9e80ffa08104-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-a3514a6d-16ee-4d73-a6ec-caddf179f2a9-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Lock "cinder-a3514a6d-16ee-4d73-a6ec-caddf179f2a9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-quobyte-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2bbfac-1053-4f3c-9bf0-800f86726833]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 Sep 01 02:21:53 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" returned: 0 in 0.386s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9 Sep 01 02:21:54 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" returned: 0 in 0.278s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-a3514a6d-16ee-4d73-a6ec-caddf179f2a9" released by "delete_volume" :: held 0.742s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Created reservations ['2fa25f74-f529-4e6e-a44f-02234c5c89b8', '8c616490-b532-4029-9889-ac1e4a0b7f15', '12e4e1ef-759a-4202-9f7c-3f21686f64bd', '9e962378-bb66-4e67-862b-1e3ee42730df'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:21:54 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-e7c8cff9-ff2b-465a-80e5-23aa80e892d1-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:55 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.356s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-e7c8cff9-ff2b-465a-80e5-23aa80e892d1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Deleted volume successfully. Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-db4b27f3-dbec-4e0b-a0da-ec564374149a tempest-VolumeDependencyTests-789017440 None] Lock "cinder-a3514a6d-16ee-4d73-a6ec-caddf179f2a9-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Acquiring lock "cinder-quobyte-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[23267315-5771-4b67-9842-710979a7f49c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:55 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 Sep 01 02:21:55 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:55 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" returned: 0 in 0.405s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:55 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1 Sep 01 02:21:55 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:55 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" returned: 0 in 0.270s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-quobyte-e7c8cff9-ff2b-465a-80e5-23aa80e892d1" released by "delete_volume" :: held 0.734s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:55 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Created reservations ['ff5b02a3-ba19-4110-ac9f-e325838b52ca', '45497e57-b0c5-4c7f-979b-32980e0ae46a', '4b84e518-7123-4d27-8ce8-ceb641f91a3d', 'fd910ece-9db5-4700-8cc2-9dc6f9e59ac1'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:56 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:21:56 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:56 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.275s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Deleted volume successfully. Sep 01 02:21:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e248b7fc-30cc-4bab-babf-d34a1e280cb0 tempest-VolumeDependencyTests-789017440 None] Lock "cinder-e7c8cff9-ff2b-465a-80e5-23aa80e892d1-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:06 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=75,cinder:UPDATE=84,cinder:INSERT=23,cinder:DELETE=4 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:06 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=83,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:22:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:22:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Flow 'volume_create_manager' (2be8e50b-a550-4cfc-a385-8b09ea963f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90b7d21-7222-464a-bcf0-24eb6cf6bbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90b7d21-7222-464a-bcf0-24eb6cf6bbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1504163120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051a8786-5489-43e2-8196-386738d0602f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372dcadf23984dc8862185749bce38cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:19Z,use_quota=True,user_id='9814e7ce7f1343eead52775a23ced703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44c9c2f-02a2-45f2-8c7d-4e914512297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44c9c2f-02a2-45f2-8c7d-4e914512297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb894ac8-daef-41c2-867b-efecb1b9da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb894ac8-daef-41c2-867b-efecb1b9da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051a8786-5489-43e2-8196-386738d0602f', 'volume_name': 'volume-051a8786-5489-43e2-8196-386738d0602f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9f708b-b6fa-4fb4-9e70-0da723201a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f9f708b-b6fa-4fb4-9e70-0da723201a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58622d84-e0c1-45e7-8ba3-b510af50c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:18 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Volume 051a8786-5489-43e2-8196-386738d0602f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051a8786-5489-43e2-8196-386738d0602f', 'volume_size': 1} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1504163120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051a8786-5489-43e2-8196-386738d0602f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372dcadf23984dc8862185749bce38cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:19Z,use_quota=True,user_id='9814e7ce7f1343eead52775a23ced703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Creating volume 051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:18 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:22:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f 1073741824 Sep 01 02:22:18 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f 1073741824" returned: 0 in 0.404s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:19 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f Sep 01 02:22:19 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f" returned: 0 in 0.239s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58622d84-e0c1-45e7-8ba3-b510af50c92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051a8786-5489-43e2-8196-386738d0602f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8102d323-6008-4c19-8ccc-388af278feb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Volume volume-051a8786-5489-43e2-8196-386738d0602f (051a8786-5489-43e2-8196-386738d0602f): created successfully Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8102d323-6008-4c19-8ccc-388af278feb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Flow 'volume_create_manager' (2be8e50b-a550-4cfc-a385-8b09ea963f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1c5b7513-c43d-42c8-b183-3217c260365a tempest-SnapshotDependencyTests-1318598271 None] Created volume successfully. Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Creating offline snapshot 0e2affc3-fbbe-4a17-8605-75b37c8b4547 of volume 051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f087b-e362-4621-ac0a-adc8ef0e8c8d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:20 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f Sep 01 02:22:20 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:20 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f" returned: 0 in 0.354s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:20 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 1G Sep 01 02:22:20 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:20 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 1G" returned: 0 in 0.371s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051a8786-5489-43e2-8196-386738d0602f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:20 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051a8786-5489-43e2-8196-386738d0602f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 Sep 01 02:22:20 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051a8786-5489-43e2-8196-386738d0602f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547" returned: 0 in 0.299s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 is being set with open permissions: ugo+rw Sep 01 02:22:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 Sep 01 02:22:21 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547" returned: 0 in 0.235s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.info Sep 01 02:22:21 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.info" returned: 0 in 0.245s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.info is being set with open permissions: ugo+rw Sep 01 02:22:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.info Sep 01 02:22:21 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.info" returned: 0 in 0.244s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-67ee86ef-2c3c-4918-b105-5916ee7f970e tempest-SnapshotDependencyTests-1318598271 None] Create snapshot completed successfully Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Flow 'volume_create_manager' (919536b7-c7cc-4137-ad6f-bc1d7caf2fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1cb06e-6315-4d4f-88db-ef20564c216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1cb06e-6315-4d4f-88db-ef20564c216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319983bd-2182-4899-9bca-b599f442517c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372dcadf23984dc8862185749bce38cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e2affc3-fbbe-4a17-8605-75b37c8b4547,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:23Z,use_quota=True,user_id='9814e7ce7f1343eead52775a23ced703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a631d6-056e-49fd-8372-f50e9977b84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a631d6-056e-49fd-8372-f50e9977b84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504d4c89-1274-4ae8-a951-67779c172e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504d4c89-1274-4ae8-a951-67779c172e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '319983bd-2182-4899-9bca-b599f442517c', 'volume_name': 'volume-319983bd-2182-4899-9bca-b599f442517c', 'volume_size': 1, 'snapshot_id': '0e2affc3-fbbe-4a17-8605-75b37c8b4547'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a164a418-5ddf-4639-bf44-282e24bca976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a164a418-5ddf-4639-bf44-282e24bca976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f32b152-f4e5-4c69-8251-3c26326e5dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Volume 319983bd-2182-4899-9bca-b599f442517c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-319983bd-2182-4899-9bca-b599f442517c', 'volume_size': 1, 'snapshot_id': '0e2affc3-fbbe-4a17-8605-75b37c8b4547'} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-quobyte-0e2affc3-fbbe-4a17-8605-75b37c8b4547-319983bd-2182-4899-9bca-b599f442517c" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-0e2affc3-fbbe-4a17-8605-75b37c8b4547-319983bd-2182-4899-9bca-b599f442517c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Creating volume 319983bd-2182-4899-9bca-b599f442517c from snapshot 0e2affc3-fbbe-4a17-8605-75b37c8b4547 {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-quobyte-319983bd-2182-4899-9bca-b599f442517c" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-319983bd-2182-4899-9bca-b599f442517c" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] snapshot: 0e2affc3-fbbe-4a17-8605-75b37c8b4547, volume: 319983bd-2182-4899-9bca-b599f442517c, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d21ebe8-c421-43fe-a6cf-f21a049ec009]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:23 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 Sep 01 02:22:23 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:23 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547" returned: 0 in 0.357s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051a8786-5489-43e2-8196-386738d0602f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a89102-b0eb-4819-9549-b63fd3e6a655]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:23 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f Sep 01 02:22:23 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:23 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f" returned: 0 in 0.354s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:22:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:23 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c Sep 01 02:22:23 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:27 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c" returned: 0 in 3.832s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f, size 1024.00 MB, duration 3.83 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:22:27 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Converted 1024.00 MB image at 267.10 MB/s Sep 01 02:22:27 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c is being set with open permissions: ugo+rw Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:27 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c Sep 01 02:22:27 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:27 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c" returned: 0 in 0.229s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-319983bd-2182-4899-9bca-b599f442517c" released by "_copy_volume_from_snapshot" :: held 4.854s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-0e2affc3-fbbe-4a17-8605-75b37c8b4547-319983bd-2182-4899-9bca-b599f442517c" released by "_create_volume_from_snapshot" :: held 4.913s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.932s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f32b152-f4e5-4c69-8251-3c26326e5dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319983bd-2182-4899-9bca-b599f442517c', 'volume_size': 1, 'snapshot_id': '0e2affc3-fbbe-4a17-8605-75b37c8b4547'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a783704-a44c-45e5-a959-79130c811b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:27 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Volume volume-319983bd-2182-4899-9bca-b599f442517c (319983bd-2182-4899-9bca-b599f442517c): created successfully Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a783704-a44c-45e5-a959-79130c811b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Flow 'volume_create_manager' (919536b7-c7cc-4137-ad6f-bc1d7caf2fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5059e957-ade2-4428-bf0b-b6f71ca3b7bc tempest-SnapshotDependencyTests-1318598271 None] Created volume successfully. Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-0e2affc3-fbbe-4a17-8605-75b37c8b4547-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-0e2affc3-fbbe-4a17-8605-75b37c8b4547-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-quobyte-051a8786-5489-43e2-8196-386738d0602f" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-051a8786-5489-43e2-8196-386738d0602f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-quobyte-0e2affc3-fbbe-4a17-8605-75b37c8b4547" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-0e2affc3-fbbe-4a17-8605-75b37c8b4547" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Deleting offline snapshot 0e2affc3-fbbe-4a17-8605-75b37c8b4547 of volume 051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] snapshot_file for this snap is: volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e03bb4e-6b15-42c7-9587-5df28cf1fe75]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:28 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 Sep 01 02:22:28 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:28 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547" returned: 0 in 0.333s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051a8786-5489-43e2-8196-386738d0602f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa3d6cf-16a5-48d8-ae7e-d20b666885c6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:28 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f Sep 01 02:22:28 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:29 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f" returned: 0 in 0.501s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:29 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 Sep 01 02:22:29 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:29 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547" returned: 0 in 0.318s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:29 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547 Sep 01 02:22:29 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:29 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f.0e2affc3-fbbe-4a17-8605-75b37c8b4547" returned: 0 in 0.229s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-0e2affc3-fbbe-4a17-8605-75b37c8b4547" released by "_delete_snapshot" :: held 1.472s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-051a8786-5489-43e2-8196-386738d0602f" released by "delete_snapshot" :: held 1.495s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Created reservations ['7827144a-7c4f-4ca1-a32b-c0d550bae013', 'bed4d5a1-57c6-416d-a328-56f7fec3123b', '71201360-eb29-4e16-936c-af5481bee990', '6b1d2402-a64b-4fa9-a8c4-aac4b69bfdc6'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Delete snapshot completed successfully. Sep 01 02:22:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41f61553-1aa3-4a7d-b551-49d13bbb59ea tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-0e2affc3-fbbe-4a17-8605-75b37c8b4547-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-051a8786-5489-43e2-8196-386738d0602f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-051a8786-5489-43e2-8196-386738d0602f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-quobyte-051a8786-5489-43e2-8196-386738d0602f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-051a8786-5489-43e2-8196-386738d0602f" acquired by "delete_volume" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:30 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a1548a-c32b-4bcc-95e4-c506c4d5a430]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:30 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f Sep 01 02:22:30 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:30 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f" returned: 0 in 0.338s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:30 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f Sep 01 02:22:30 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:31 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-051a8786-5489-43e2-8196-386738d0602f" returned: 0 in 0.250s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-051a8786-5489-43e2-8196-386738d0602f" released by "delete_volume" :: held 0.645s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Created reservations ['195fb3ca-27d3-412f-9c3d-4e579df492dd', 'e04748e6-363d-48ef-9876-85ca4bd88adb', '074ef4a9-a129-45fa-a09e-f66d7e476908', 'ec652d20-b737-49c2-bd20-867645c96408'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:31 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:22:31 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:31 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.231s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Deleted volume successfully. Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-340ed890-2e29-43ea-87c3-ca966980752a tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-051a8786-5489-43e2-8196-386738d0602f-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-319983bd-2182-4899-9bca-b599f442517c-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-319983bd-2182-4899-9bca-b599f442517c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "cinder-quobyte-319983bd-2182-4899-9bca-b599f442517c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-319983bd-2182-4899-9bca-b599f442517c" acquired by "delete_volume" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8f8593-eb2b-46f9-b601-4c4d755f73bd]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:31 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c Sep 01 02:22:31 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:32 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c" returned: 0 in 0.339s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:32 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c Sep 01 02:22:32 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:32 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-319983bd-2182-4899-9bca-b599f442517c" returned: 0 in 0.245s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-quobyte-319983bd-2182-4899-9bca-b599f442517c" released by "delete_volume" :: held 0.621s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Created reservations ['e0242ab9-fcde-4820-a084-65b2482925e3', '968e3366-a05e-4404-83c1-aeb2a77d156d', 'f41f2909-48b9-469f-9b87-8d35ee971b19', '5f375b43-4fcd-4152-8731-e971a83ae49f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:32 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:22:32 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:32 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.235s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Deleted volume successfully. Sep 01 02:22:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-67ced039-9f6d-4e81-96ef-c76865aa3307 tempest-SnapshotDependencyTests-1318598271 None] Lock "cinder-319983bd-2182-4899-9bca-b599f442517c-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:42 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:42 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:53 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (54f571b4-0094-4abe-9387-664d93fd57d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8f8c18-3a4f-4839-84ca-590880efd111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8f8c18-3a4f-4839-84ca-590880efd111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681061846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69f4765-b9c0-432f-bc97-58ab8e310a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:54Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c804e5-ffae-460d-8766-ecaef80c6192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c804e5-ffae-460d-8766-ecaef80c6192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c871ad05-1e0c-4dea-80e7-f729b2f8adc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c871ad05-1e0c-4dea-80e7-f729b2f8adc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69f4765-b9c0-432f-bc97-58ab8e310a5f', 'volume_name': 'volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7008b4b3-1ee2-40ed-a1f7-097368d75b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7008b4b3-1ee2-40ed-a1f7-097368d75b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50718370-dec9-4595-b7df-e640005e5b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume a69f4765-b9c0-432f-bc97-58ab8e310a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f', 'volume_size': 1} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681061846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69f4765-b9c0-432f-bc97-58ab8e310a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:54Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Creating volume a69f4765-b9c0-432f-bc97-58ab8e310a5f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:54 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:54 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f 1073741824 Sep 01 02:22:54 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (d457caa5-0894-40ec-a1e2-b983579c52c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6f7ebd-dec9-46f2-bf4d-f8247a1342c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b6f7ebd-dec9-46f2-bf4d-f8247a1342c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1116290075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e040cb7-acd4-4b3a-995c-b657f9d985e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:55Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c60609-fb98-4930-b4a2-02275293e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c60609-fb98-4930-b4a2-02275293e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9028bd71-bdd8-4df6-b3fe-3c21d11aaffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9028bd71-bdd8-4df6-b3fe-3c21d11aaffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e040cb7-acd4-4b3a-995c-b657f9d985e7', 'volume_name': 'volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b7313c-7f44-4820-8212-449decf9a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b7313c-7f44-4820-8212-449decf9a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b5294c-f145-4a6c-9fee-20afe737f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:54 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Volume 4e040cb7-acd4-4b3a-995c-b657f9d985e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7', 'volume_size': 1} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:54 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f 1073741824" returned: 0 in 0.751s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:54 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:54 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f Sep 01 02:22:54 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (51585af5-569f-4028-a341-c036288fec3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b944b2-cc4b-4018-b94b-1f1d4b52fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b944b2-cc4b-4018-b94b-1f1d4b52fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-468676970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2d6b6e-6d7c-41fa-a769-876744a0f51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:55Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94091703-fab7-4d37-b178-776ece785857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94091703-fab7-4d37-b178-776ece785857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdbc4a1-67e0-4b0d-9585-dcd5bede1a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdbc4a1-67e0-4b0d-9585-dcd5bede1a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2d6b6e-6d7c-41fa-a769-876744a0f51e', 'volume_name': 'volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94df7db-3a64-4c20-b913-112471fa0e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94df7db-3a64-4c20-b913-112471fa0e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7c7ab3-7547-4de9-b27c-e67d11b0f6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Volume 0b2d6b6e-6d7c-41fa-a769-876744a0f51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e', 'volume_size': 1} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:55 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f" returned: 0 in 0.372s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.605s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1116290075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e040cb7-acd4-4b3a-995c-b657f9d985e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:55Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Creating volume 4e040cb7-acd4-4b3a-995c-b657f9d985e7 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:55 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:55 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 1073741824 Sep 01 02:22:55 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50718370-dec9-4595-b7df-e640005e5b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d3b861-23f6-4074-a41d-b8b84d693357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f (a69f4765-b9c0-432f-bc97-58ab8e310a5f): created successfully Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d3b861-23f6-4074-a41d-b8b84d693357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (54f571b4-0094-4abe-9387-664d93fd57d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (ebe5f7e7-a6d3-4f67-bac8-88bd1dd112b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4502d35-bd4e-488b-8137-046b7852bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4502d35-bd4e-488b-8137-046b7852bb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-349561044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9d9f23-89fc-4dcb-a6a4-c765b1770251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:55Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbeed7e-098d-49aa-9fca-b279353252ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbbeed7e-098d-49aa-9fca-b279353252ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b81e91-9a4b-47f4-ac47-c59ab0097689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b81e91-9a4b-47f4-ac47-c59ab0097689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9d9f23-89fc-4dcb-a6a4-c765b1770251', 'volume_name': 'volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0af6c97-28de-4fdb-8fc1-5d673f315500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0af6c97-28de-4fdb-8fc1-5d673f315500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdf9c5b-250d-4f5c-b404-67538dfb3819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:55 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Volume fd9d9f23-89fc-4dcb-a6a4-c765b1770251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251', 'volume_size': 1} Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-522903c0-1da4-46b3-a69b-11bef235e8c4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created volume successfully. Sep 01 02:22:55 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (a9afd781-6e81-42c7-a1fd-7942522ca129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:56 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb76b0c3-fa49-4a5c-a8aa-1b8e118cd6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 1073741824" returned: 0 in 0.688s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb76b0c3-fa49-4a5c-a8aa-1b8e118cd6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528506043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b109c2d5-6da6-4f07-9531-80c00469df17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:56Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fb2e0c-1981-46cd-81c4-1a9a4c6964a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58fb2e0c-1981-46cd-81c4-1a9a4c6964a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0ddd1d-0636-49b2-846a-8ff64d845ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0ddd1d-0636-49b2-846a-8ff64d845ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b109c2d5-6da6-4f07-9531-80c00469df17', 'volume_name': 'volume-b109c2d5-6da6-4f07-9531-80c00469df17', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b033c-84bf-4add-868c-7ac36aeae084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (936b033c-84bf-4add-868c-7ac36aeae084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a068cdf8-9064-4dbc-8696-12d9b7bec7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Volume b109c2d5-6da6-4f07-9531-80c00469df17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b109c2d5-6da6-4f07-9531-80c00469df17', 'volume_size': 1} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 Sep 01 02:22:56 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7" returned: 0 in 0.444s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.545s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-468676970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2d6b6e-6d7c-41fa-a769-876744a0f51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:55Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Creating volume 0b2d6b6e-6d7c-41fa-a769-876744a0f51e {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:56 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b5294c-f145-4a6c-9fee-20afe737f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cffee9-1f12-4683-9afc-871eb550a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Volume volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 (4e040cb7-acd4-4b3a-995c-b657f9d985e7): created successfully Sep 01 02:22:56 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e 1073741824 Sep 01 02:22:56 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84cffee9-1f12-4683-9afc-871eb550a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (d457caa5-0894-40ec-a1e2-b983579c52c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6e5d458e-a5ee-4dfb-ae2f-0ea7ac53a72f tempest-CreateVolumesFromImageTest-1245275982 None] Created volume successfully. Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (e2abf13b-9960-4a99-acbb-a2bb16fbca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c7af6c-d8ac-4989-a224-da8f929c6171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c7af6c-d8ac-4989-a224-da8f929c6171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1097911596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36066d84-99a5-437e-a6b1-ebfab6732787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:57Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2c483e-ff5a-4860-b141-62a59ff1bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2c483e-ff5a-4860-b141-62a59ff1bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2bace0-5e3a-45b7-9a63-d41aac6186a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2bace0-5e3a-45b7-9a63-d41aac6186a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36066d84-99a5-437e-a6b1-ebfab6732787', 'volume_name': 'volume-36066d84-99a5-437e-a6b1-ebfab6732787', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb48764-4102-4a99-a6aa-c342444aebef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb48764-4102-4a99-a6aa-c342444aebef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92e7559-b004-485a-b103-bb6cbe56085f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Volume 36066d84-99a5-437e-a6b1-ebfab6732787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36066d84-99a5-437e-a6b1-ebfab6732787', 'volume_size': 1} Sep 01 02:22:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:57 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e 1073741824" returned: 0 in 0.599s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:57 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e Sep 01 02:22:57 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:57 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.940s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-349561044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9d9f23-89fc-4dcb-a6a4-c765b1770251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:55Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Creating volume fd9d9f23-89fc-4dcb-a6a4-c765b1770251 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:57 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7c7ab3-7547-4de9-b27c-e67d11b0f6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce669b0-83c9-43f7-a4e7-2bae8f03647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:57 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 1073741824 Sep 01 02:22:57 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Volume volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e (0b2d6b6e-6d7c-41fa-a769-876744a0f51e): created successfully Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce669b0-83c9-43f7-a4e7-2bae8f03647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (51585af5-569f-4028-a341-c036288fec3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0f7104fb-734d-4262-ac4d-45e23cf5cdac tempest-CreateVolumesFromImageTest-1245275982 None] Created volume successfully. Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Flow 'volume_create_manager' (2d386eca-fa30-4e87-afe5-a5893cb2ba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd29506-852f-4916-8d3a-9c26c633eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd29506-852f-4916-8d3a-9c26c633eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7153d7b-8058-4d20-a8ee-529483fa9e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a7a0c44c4647f1b5aa14127a191472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:58Z,use_quota=True,user_id='ed125d5fffc541a78add6ac844aa0a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981d5abe-72f3-4f31-a20e-a42b75d3a90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981d5abe-72f3-4f31-a20e-a42b75d3a90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5670513-c08f-4eb9-8d7a-3e9a9f87ad4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:22:58 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 1073741824" returned: 0 in 0.643s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:58 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 Sep 01 02:22:58 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5670513-c08f-4eb9-8d7a-3e9a9f87ad4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7153d7b-8058-4d20-a8ee-529483fa9e3d', 'volume_name': 'volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d', 'volume_size': 1, 'image_id': 'f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fe6e80e9dae37042e5350ff9ea83b85', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '88a7a0c44c4647f1b5aa14127a191472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '075b9957f921cbb67bc15f00f7c340be6e4e2ed10bf6b09f1a80206ecc0ba55aefaaf68d4411c5a18b9bd978661dd29c28ef7220c05140efa113e2d210ab48c7', 'id': 'f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d/file', 'properties': {}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ed58dc-8fb7-41ef-bbe1-b5b8ec6d3b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ed58dc-8fb7-41ef-bbe1-b5b8ec6d3b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa864fd-a681-4545-9cc5-f8a10bf4f2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:58 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Volume f7153d7b-8058-4d20-a8ee-529483fa9e3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d', 'volume_size': 1, 'image_id': 'f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fe6e80e9dae37042e5350ff9ea83b85', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '88a7a0c44c4647f1b5aa14127a191472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '075b9957f921cbb67bc15f00f7c340be6e4e2ed10bf6b09f1a80206ecc0ba55aefaaf68d4411c5a18b9bd978661dd29c28ef7220c05140efa113e2d210ab48c7', 'id': 'f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d/file', 'properties': {}}, 'image_service': } Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Trying to clone f7153d7b-8058-4d20-a8ee-529483fa9e3d from image f5f64563-8dc9-467a-9c1b-0fa2e0a0648d at location (None, [{'url': 'file:///opt/stack/data/glance/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:22:58 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:22:58 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aa75ad-98f3-4302-b276-f4aefe83c1cf]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251" returned: 0 in 0.285s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.439s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528506043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b109c2d5-6da6-4f07-9531-80c00469df17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:56Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Creating volume b109c2d5-6da6-4f07-9531-80c00469df17 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:58 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:58 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 1073741824 Sep 01 02:22:58 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdf9c5b-250d-4f5c-b404-67538dfb3819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43edcc96-6074-446b-878f-13cb744cc61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:58 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Volume volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 (fd9d9f23-89fc-4dcb-a6a4-c765b1770251): created successfully Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43edcc96-6074-446b-878f-13cb744cc61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (ebe5f7e7-a6d3-4f67-bac8-88bd1dd112b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:58 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD Sep 01 02:22:58 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:58 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-99563d37-8c33-407f-be1d-847f32952097 tempest-CreateVolumesFromImageTest-1245275982 None] Created volume successfully. Sep 01 02:22:58 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD Sep 01 02:22:59 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 1073741824" returned: 0 in 0.621s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 Sep 01 02:22:59 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Flow 'volume_create_manager' (1009b7e2-14a5-4bcb-ac35-1b277c1af88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d2f4b2-8239-414d-8482-43532e8db857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Temporary image f5f64563-8dc9-467a-9c1b-0fa2e0a0648d is fetched for user ed125d5fffc541a78add6ac844aa0a84. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10d2f4b2-8239-414d-8482-43532e8db857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44fef34-a8ef-4694-a460-98f7df86f891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1232bc4534c645a991d072ac4c434d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:59Z,use_quota=True,user_id='7642b9dec7324cf39e2e8147a413811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e21c1d33-786b-4610-ad87-e5fb1ad07e86),volume_type_id=e21c1d33-786b-4610-ad87-e5fb1ad07e86)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ee06f2-b785-48c2-8382-657990d5ab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ee06f2-b785-48c2-8382-657990d5ab5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c0ed00-691a-4852-a98b-950479d108d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.image.glance [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Creating Keystone auth plugin from conf {{(pid=87425) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abfbc44-f40e-4083-89d7-c340a034b4b3]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.719s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:59 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD Sep 01 02:22:59 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a068cdf8-9064-4dbc-8696-12d9b7bec7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b109c2d5-6da6-4f07-9531-80c00469df17', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb81ddc5-8899-4e47-be9d-6426b1eeab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Creating offline snapshot b7a3f72f-692e-4b6a-8c75-846344a1d2eb of volume a69f4765-b9c0-432f-bc97-58ab8e310a5f {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Volume volume-b109c2d5-6da6-4f07-9531-80c00469df17 (b109c2d5-6da6-4f07-9531-80c00469df17): created successfully Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb81ddc5-8899-4e47-be9d-6426b1eeab55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (a9afd781-6e81-42c7-a1fd-7942522ca129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc48e9e-b3da-403b-870a-53ea188557b5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c0ed00-691a-4852-a98b-950479d108d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b44fef34-a8ef-4694-a460-98f7df86f891', 'volume_name': 'volume-b44fef34-a8ef-4694-a460-98f7df86f891', 'volume_size': 1, 'image_id': '1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '825dc71c068992fcd16ccea284a5bc0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1232bc4534c645a991d072ac4c434d85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ea7e5872079b6856020b8f87b656356ac6fa629470ff06227da27e9b1f9be7b28c72ab2b3bf327facb3a9dd2d7c7c201eaf61acd564838aeff0091e3785858f', 'id': '1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a655b26-8f9d-4ff7-9e7a-9238fecc3bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a655b26-8f9d-4ff7-9e7a-9238fecc3bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d775601f-f216-4879-a02f-57ad5f8816a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Volume b44fef34-a8ef-4694-a460-98f7df86f891: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b44fef34-a8ef-4694-a460-98f7df86f891', 'volume_size': 1, 'image_id': '1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '825dc71c068992fcd16ccea284a5bc0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1232bc4534c645a991d072ac4c434d85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ea7e5872079b6856020b8f87b656356ac6fa629470ff06227da27e9b1f9be7b28c72ab2b3bf327facb3a9dd2d7c7c201eaf61acd564838aeff0091e3785858f', 'id': '1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Trying to clone b44fef34-a8ef-4694-a460-98f7df86f891 from image 1ae492d9-3fcd-4c3a-b1a5-42507926f335 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'metadata': {}}]). {{(pid=87425) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:22:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a5f21770-ce47-4477-85fa-db014ebef241 tempest-CreateVolumesFromImageTest-1245275982 None] Created volume successfully. Sep 01 02:22:59 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f Sep 01 02:22:59 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:22:59 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:22:59 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab702a5a-2860-4035-97ee-587236610b7d]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD Sep 01 02:22:59 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD Sep 01 02:22:59 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f" returned: 0 in 0.429s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb 1G Sep 01 02:23:00 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:00 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD Sep 01 02:23:00 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb 1G" returned: 0 in 0.430s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb Sep 01 02:23:00 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Temporary image 1ae492d9-3fcd-4c3a-b1a5-42507926f335 is fetched for user 7642b9dec7324cf39e2e8147a413811b. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ae5711-4fb1-4002-aac5-3e296287201d]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD Sep 01 02:23:00 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb" returned: 0 in 0.314s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb is being set with open permissions: ugo+rw Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb Sep 01 02:23:00 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:01 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb" returned: 0 in 0.275s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:01 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD Sep 01 02:23:01 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:01 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.info Sep 01 02:23:01 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:01 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:01 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.info" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:01 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.info is being set with open permissions: ugo+rw Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:01 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.info Sep 01 02:23:01 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:01 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.info" returned: 0 in 0.267s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.724s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1097911596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36066d84-99a5-437e-a6b1-ebfab6732787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fb4bdb29f9a404b827f10569103a48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:57Z,use_quota=True,user_id='bdad075067924d6dac28f99729358de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Creating volume 36066d84-99a5-437e-a6b1-ebfab6732787 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:01 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:01 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 1073741824 Sep 01 02:23:01 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:01 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-78d663e0-a659-4cd3-9ad3-d464b79c8518 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Create snapshot completed successfully Sep 01 02:23:02 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 1073741824" returned: 0 in 0.501s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:02 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 Sep 01 02:23:02 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (c97c504e-edc1-4f65-b8a3-f49d363ab534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d61f989-6786-4cc7-bcd7-6c0f63c5d089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d61f989-6786-4cc7-bcd7-6c0f63c5d089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-44785018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398a03c9-ee76-47f3-a096-69b1343c0aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:02Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f319d5a8-6575-4c3d-bb09-a186d150583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f319d5a8-6575-4c3d-bb09-a186d150583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fb5e40-6642-47b5-9d5b-de32529a102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fb5e40-6642-47b5-9d5b-de32529a102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398a03c9-ee76-47f3-a096-69b1343c0aea', 'volume_name': 'volume-398a03c9-ee76-47f3-a096-69b1343c0aea', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f336f2e6-2b1a-4df3-8eb1-5b0f003993f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f336f2e6-2b1a-4df3-8eb1-5b0f003993f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3767116a-916c-49b2-91de-263857f115c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume 398a03c9-ee76-47f3-a096-69b1343c0aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398a03c9-ee76-47f3-a096-69b1343c0aea', 'volume_size': 1} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787" returned: 0 in 0.366s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.409s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7153d7b-8058-4d20-a8ee-529483fa9e3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88a7a0c44c4647f1b5aa14127a191472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:58Z,use_quota=True,user_id='ed125d5fffc541a78add6ac844aa0a84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Creating volume f7153d7b-8058-4d20-a8ee-529483fa9e3d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:02 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92e7559-b004-485a-b103-bb6cbe56085f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36066d84-99a5-437e-a6b1-ebfab6732787', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d 1073741824 Sep 01 02:23:02 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99857aa8-7ed5-4fa2-b80b-76c1e69a1a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Volume volume-36066d84-99a5-437e-a6b1-ebfab6732787 (36066d84-99a5-437e-a6b1-ebfab6732787): created successfully Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99857aa8-7ed5-4fa2-b80b-76c1e69a1a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Flow 'volume_create_manager' (e2abf13b-9960-4a99-acbb-a2bb16fbca2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:02 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-837a65f1-9fd7-4a9a-abe5-b4d136e418a5 tempest-CreateVolumesFromImageTest-1245275982 None] Created volume successfully. Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (2bc66c66-feae-40c5-9df6-95b8e01435a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a62330-3134-4ccc-90f1-e7173ea9deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a62330-3134-4ccc-90f1-e7173ea9deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-266504400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4a799f-918a-4853-97cc-1a829d05ca40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:03Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be02c9e-4df2-4047-8e2e-4f760af18c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be02c9e-4df2-4047-8e2e-4f760af18c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468ab720-3621-4dda-916c-cc45a377b780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (468ab720-3621-4dda-916c-cc45a377b780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4a799f-918a-4853-97cc-1a829d05ca40', 'volume_name': 'volume-4f4a799f-918a-4853-97cc-1a829d05ca40', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86edac10-8c6b-43e1-b7b4-ce57533d2843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86edac10-8c6b-43e1-b7b4-ce57533d2843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a27e67-975b-402e-b502-b96c73c9d72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume 4f4a799f-918a-4853-97cc-1a829d05ca40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4a799f-918a-4853-97cc-1a829d05ca40', 'volume_size': 1} Sep 01 02:23:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:03 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d 1073741824" returned: 0 in 0.524s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:03 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d Sep 01 02:23:03 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (11cf9a91-46f2-43d3-b393-4cb9a45293b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb81d2e-bd46-482f-b859-3db618584784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb81d2e-bd46-482f-b859-3db618584784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469352680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ea142-09bd-443b-b718-d97902ed5ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:03Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fc1290-3fe5-4eed-93c5-9202ef8e5d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7fc1290-3fe5-4eed-93c5-9202ef8e5d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767f7cc0-ddfd-422f-b968-f2aa4ba60040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767f7cc0-ddfd-422f-b968-f2aa4ba60040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438ea142-09bd-443b-b718-d97902ed5ef0', 'volume_name': 'volume-438ea142-09bd-443b-b718-d97902ed5ef0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22698aae-ec93-4ee0-a99e-fa1f0f8bf487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22698aae-ec93-4ee0-a99e-fa1f0f8bf487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c874f95-b94e-4510-9b48-1a8161db5051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:03 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume 438ea142-09bd-443b-b718-d97902ed5ef0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438ea142-09bd-443b-b718-d97902ed5ef0', 'volume_size': 1} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:03 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d" returned: 0 in 0.326s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.181s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44fef34-a8ef-4694-a460-98f7df86f891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1232bc4534c645a991d072ac4c434d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:59Z,use_quota=True,user_id='7642b9dec7324cf39e2e8147a413811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e21c1d33-786b-4610-ad87-e5fb1ad07e86),volume_type_id=e21c1d33-786b-4610-ad87-e5fb1ad07e86)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Creating volume b44fef34-a8ef-4694-a460-98f7df86f891 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:03 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:03 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 1073741824 Sep 01 02:23:03 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-36066d84-99a5-437e-a6b1-ebfab6732787-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-36066d84-99a5-437e-a6b1-ebfab6732787-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Attempting download of f5f64563-8dc9-467a-9c1b-0fa2e0a0648d ((None, [{'url': 'file:///opt/stack/data/glance/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'metadata': {}}])) to volume f7153d7b-8058-4d20-a8ee-529483fa9e3d. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-quobyte-36066d84-99a5-437e-a6b1-ebfab6732787" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-36066d84-99a5-437e-a6b1-ebfab6732787" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c0c6f-56fc-4c64-baa3-73cc2d385561]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_yosecrj0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[0187d3ed-9663-4029-9034-72d99ae4e15e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:03 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_yosecrj0 Sep 01 02:23:03 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:03 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:03 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 Sep 01 02:23:03 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (1e08b5e0-836e-4b34-ab3d-1851393e122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023a1f10-01b6-4de0-badb-33f17edfe98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023a1f10-01b6-4de0-badb-33f17edfe98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564380569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d09c9f-e36d-40b5-8422-0a8b984c74d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce718ec8-0971-4ad3-8d74-2328d01157f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce718ec8-0971-4ad3-8d74-2328d01157f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808e53ff-e5bf-410c-bed4-8ada160d0822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808e53ff-e5bf-410c-bed4-8ada160d0822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d09c9f-e36d-40b5-8422-0a8b984c74d0', 'volume_name': 'volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3031a4c-834f-408b-b59a-80c15d40d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3031a4c-834f-408b-b59a-80c15d40d972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee733507-a42c-4eb2-a553-2fed06f58030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume 88d09c9f-e36d-40b5-8422-0a8b984c74d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0', 'volume_size': 1} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 1073741824" returned: 0 in 0.739s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_yosecrj0" returned: 0 in 0.487s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_yosecrj0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787" returned: 0 in 0.558s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 Sep 01 02:23:04 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787 Sep 01 02:23:04 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_yosecrj0 Sep 01 02:23:04 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (1afdb987-0ae8-411b-8fae-722707719809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063d6cd2-9df1-475f-b663-e51db897b2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063d6cd2-9df1-475f-b663-e51db897b2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145349127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7deec23b-13a1-4c59-80d8-8c62ce743620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f91be6a-88e9-4931-b78c-10e5d93e091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f91be6a-88e9-4931-b78c-10e5d93e091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ca1369-ece3-4060-a0c3-fca4ec470914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4ca1369-ece3-4060-a0c3-fca4ec470914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7deec23b-13a1-4c59-80d8-8c62ce743620', 'volume_name': 'volume-7deec23b-13a1-4c59-80d8-8c62ce743620', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ced009-c490-400c-a328-351f0baca3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78ced009-c490-400c-a328-351f0baca3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25fa218-9a47-4f26-b5cb-2a74d54340a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:04 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume 7deec23b-13a1-4c59-80d8-8c62ce743620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7deec23b-13a1-4c59-80d8-8c62ce743620', 'volume_size': 1} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891" returned: 0 in 0.306s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.056s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-44785018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398a03c9-ee76-47f3-a096-69b1343c0aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:02Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Creating volume 398a03c9-ee76-47f3-a096-69b1343c0aea {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:04 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-36066d84-99a5-437e-a6b1-ebfab6732787" returned: 0 in 0.315s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_yosecrj0" returned: 1 in 0.426s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_yosecrj0' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-36066d84-99a5-437e-a6b1-ebfab6732787" released by "delete_volume" :: held 0.953s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fe82a7-764c-440a-a21d-a277a8b8b905]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea 1073741824 Sep 01 02:23:04 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Attempting download of 1ae492d9-3fcd-4c3a-b1a5-42507926f335 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'metadata': {}}])) to volume b44fef34-a8ef-4694-a460-98f7df86f891. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Created reservations ['50e8565d-dc62-40f2-b469-1a0cf6e45fff', '350ae096-7a69-47f9-a9b8-439b152f56ec', 'a8f362f2-bbb1-4a48-b79b-e770d0c05f20', '1fb262af-e991-4187-99ef-36e49d9175df'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[328d7ba3-be3a-445b-826c-9b338d26895d]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ae492d9-3fcd-4c3a-b1a5-42507926f335_5la5imo_ {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD Sep 01 02:23:04 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:04 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ae492d9-3fcd-4c3a-b1a5-42507926f335_5la5imo_ Sep 01 02:23:04 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea 1073741824" returned: 0 in 0.480s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ae492d9-3fcd-4c3a-b1a5-42507926f335_5la5imo_" returned: 0 in 0.406s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea Sep 01 02:23:05 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ae492d9-3fcd-4c3a-b1a5-42507926f335_5la5imo_ {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.321s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:05 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD Sep 01 02:23:05 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Deleted volume successfully. Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-41e4834a-6ca8-4c6d-9cbf-0599c7396f34 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-36066d84-99a5-437e-a6b1-ebfab6732787-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:05 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ae492d9-3fcd-4c3a-b1a5-42507926f335_5la5imo_ Sep 01 02:23:05 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea" returned: 0 in 0.308s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.501s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-266504400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4a799f-918a-4853-97cc-1a829d05ca40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:03Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Creating volume 4f4a799f-918a-4853-97cc-1a829d05ca40 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:05 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD" returned: 1 in 0.437s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3767116a-916c-49b2-91de-263857f115c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398a03c9-ee76-47f3-a096-69b1343c0aea', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fb5897-4308-4775-9402-784028257fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] f5f64563-8dc9-467a-9c1b-0fa2e0a0648d was raw, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:23:05 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 1073741824 Sep 01 02:23:05 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume volume-398a03c9-ee76-47f3-a096-69b1343c0aea (398a03c9-ee76-47f3-a096-69b1343c0aea): created successfully Sep 01 02:23:05 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fb5897-4308-4775-9402-784028257fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:05 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (c97c504e-edc1-4f65-b8a3-f49d363ab534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:05 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-47e08252-46ea-4175-8273-5b97ca5b5a8d tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created volume successfully. Sep 01 02:23:05 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ae492d9-3fcd-4c3a-b1a5-42507926f335_5la5imo_" returned: 1 in 0.424s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ae492d9-3fcd-4c3a-b1a5-42507926f335_5la5imo_' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef69df85-44d4-4474-b550-f61b96720003]: (4, 'raw') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD Sep 01 02:23:05 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-b109c2d5-6da6-4f07-9531-80c00469df17-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-b109c2d5-6da6-4f07-9531-80c00469df17-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-quobyte-b109c2d5-6da6-4f07-9531-80c00469df17" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-b109c2d5-6da6-4f07-9531-80c00469df17" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:06 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 1073741824" returned: 0 in 0.560s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b1ef57-9b20-47ab-ab8e-0664ee0c8dae]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d" returned: 0 in 0.570s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f5f64563-8dc9-467a-9c1b-0fa2e0a0648d_5_x2wa7ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:23:06 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d 1G Sep 01 02:23:06 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 Sep 01 02:23:06 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 Sep 01 02:23:06 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD Sep 01 02:23:06 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:06 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD" returned: 1 in 0.461s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] 1ae492d9-3fcd-4c3a-b1a5-42507926f335 was raw, converting to qcow2 {{(pid=87425) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:23:06 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40" returned: 0 in 0.429s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17" returned: 0 in 0.511s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:06 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 Sep 01 02:23:06 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.203s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1469352680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=438ea142-09bd-443b-b718-d97902ed5ef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:03Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Creating volume 438ea142-09bd-443b-b718-d97902ed5ef0 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:06 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17 Sep 01 02:23:06 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d 1G" returned: 0 in 0.518s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Downloaded image f5f64563-8dc9-467a-9c1b-0fa2e0a0648d ((None, [{'url': 'file:///opt/stack/data/glance/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'metadata': {}}])) to volume f7153d7b-8058-4d20-a8ee-529483fa9e3d successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Temporary image f5f64563-8dc9-467a-9c1b-0fa2e0a0648d for user ed125d5fffc541a78add6ac844aa0a84 is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Marking volume f7153d7b-8058-4d20-a8ee-529483fa9e3d as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a27e67-975b-402e-b502-b96c73c9d72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4a799f-918a-4853-97cc-1a829d05ca40', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa57fe76-7681-4621-aec3-09ed15d46282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 1073741824 Sep 01 02:23:06 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Copying metadata from image f5f64563-8dc9-467a-9c1b-0fa2e0a0648d to f7153d7b-8058-4d20-a8ee-529483fa9e3d. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Creating volume glance metadata for volume f7153d7b-8058-4d20-a8ee-529483fa9e3d backed by image f5f64563-8dc9-467a-9c1b-0fa2e0a0648d with: {'image_id': 'f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6fe6e80e9dae37042e5350ff9ea83b85', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:23:06 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume volume-4f4a799f-918a-4853-97cc-1a829d05ca40 (4f4a799f-918a-4853-97cc-1a829d05ca40): created successfully Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa57fe76-7681-4621-aec3-09ed15d46282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (2bc66c66-feae-40c5-9df6-95b8e01435a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5e0894d5-9943-491c-8825-daa1ff3a2972 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created volume successfully. Sep 01 02:23:06 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.403s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa864fd-a681-4545-9cc5-f8a10bf4f2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d', 'volume_size': 1, 'image_id': 'f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6fe6e80e9dae37042e5350ff9ea83b85', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '88a7a0c44c4647f1b5aa14127a191472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '075b9957f921cbb67bc15f00f7c340be6e4e2ed10bf6b09f1a80206ecc0ba55aefaaf68d4411c5a18b9bd978661dd29c28ef7220c05140efa113e2d210ab48c7', 'id': 'f5f64563-8dc9-467a-9c1b-0fa2e0a0648d', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5f64563-8dc9-467a-9c1b-0fa2e0a0648d/file', 'properties': {}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22afc2d1-8b5e-4e24-9c9c-7318b2e29f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Volume volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d (f7153d7b-8058-4d20-a8ee-529483fa9e3d): created successfully Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22afc2d1-8b5e-4e24-9c9c-7318b2e29f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Flow 'volume_create_manager' (2d386eca-fa30-4e87-afe5-a5893cb2ba84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e677a4af-d73e-4454-b918-96bc896f3e42 tempest-VolumeImageDependencyTests-1136320741 None] Created volume successfully. Sep 01 02:23:06 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b109c2d5-6da6-4f07-9531-80c00469df17" returned: 0 in 0.326s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-b109c2d5-6da6-4f07-9531-80c00469df17" released by "delete_volume" :: held 0.896s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:06 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Created reservations ['d03e8bc6-afbe-4ddd-ad69-f1547a44275f', '669111cd-997c-4731-a01e-5ca20e3f4258', '661bce7f-84f9-408a-82cf-b0e20c2e3d68', '45104b0a-7149-4393-a746-e6bff631285c'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:07 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-fd9d9f23-89fc-4dcb-a6a4-c765b1770251-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-fd9d9f23-89fc-4dcb-a6a4-c765b1770251-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:07 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 1073741824" returned: 0 in 0.586s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-quobyte-fd9d9f23-89fc-4dcb-a6a4-c765b1770251" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-fd9d9f23-89fc-4dcb-a6a4-c765b1770251" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aeb93f-8e7a-4edb-997c-d1bea05435fc]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891" returned: 0 in 0.734s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ae492d9-3fcd-4c3a-b1a5-42507926f335_05zk811cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:23:07 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 Sep 01 02:23:07 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 1G Sep 01 02:23:07 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.342s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:07 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Deleted volume successfully. Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7c1c4a11-894f-4c66-a3f2-8efa20c53585 tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-b109c2d5-6da6-4f07-9531-80c00469df17-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:07 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0" returned: 0 in 0.323s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.528s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564380569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d09c9f-e36d-40b5-8422-0a8b984c74d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Creating volume 88d09c9f-e36d-40b5-8422-0a8b984c74d0 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:07 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 1073741824 Sep 01 02:23:07 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c874f95-b94e-4510-9b48-1a8161db5051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438ea142-09bd-443b-b718-d97902ed5ef0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133a22c3-c538-45ee-b942-0384c63ed35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:07 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume volume-438ea142-09bd-443b-b718-d97902ed5ef0 (438ea142-09bd-443b-b718-d97902ed5ef0): created successfully Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133a22c3-c538-45ee-b942-0384c63ed35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (11cf9a91-46f2-43d3-b393-4cb9a45293b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:07 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3aff6928-786d-4226-b5a5-29904ed360d0 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created volume successfully. Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Acquiring lock "cinder-f7153d7b-8058-4d20-a8ee-529483fa9e3d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:07 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251" returned: 0 in 0.557s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 1G" returned: 0 in 0.545s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Downloaded image 1ae492d9-3fcd-4c3a-b1a5-42507926f335 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'metadata': {}}])) to volume b44fef34-a8ef-4694-a460-98f7df86f891 successfully. {{(pid=87425) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Temporary image 1ae492d9-3fcd-4c3a-b1a5-42507926f335 for user 7642b9dec7324cf39e2e8147a413811b is deleted. {{(pid=87425) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.volume_utils [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Marking volume b44fef34-a8ef-4694-a460-98f7df86f891 as bootable. {{(pid=87425) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Lock "cinder-f7153d7b-8058-4d20-a8ee-529483fa9e3d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:07 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251 Sep 01 02:23:07 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Copying metadata from image 1ae492d9-3fcd-4c3a-b1a5-42507926f335 to b44fef34-a8ef-4694-a460-98f7df86f891. {{(pid=87425) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Creating volume glance metadata for volume b44fef34-a8ef-4694-a460-98f7df86f891 backed by image 1ae492d9-3fcd-4c3a-b1a5-42507926f335 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '825dc71c068992fcd16ccea284a5bc0a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87425) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Acquiring lock "cinder-quobyte-f7153d7b-8058-4d20-a8ee-529483fa9e3d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Lock "cinder-quobyte-f7153d7b-8058-4d20-a8ee-529483fa9e3d" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4531c7-0daf-4a5f-a0f7-8affdaa97a17]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d775601f-f216-4879-a02f-57ad5f8816a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44fef34-a8ef-4694-a460-98f7df86f891', 'volume_size': 1, 'image_id': '1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '825dc71c068992fcd16ccea284a5bc0a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1232bc4534c645a991d072ac4c434d85', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4ea7e5872079b6856020b8f87b656356ac6fa629470ff06227da27e9b1f9be7b28c72ab2b3bf327facb3a9dd2d7c7c201eaf61acd564838aeff0091e3785858f', 'id': '1ae492d9-3fcd-4c3a-b1a5-42507926f335', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ae492d9-3fcd-4c3a-b1a5-42507926f335/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f81350-ec4e-47d4-a576-1287744750bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Volume volume-b44fef34-a8ef-4694-a460-98f7df86f891 (b44fef34-a8ef-4694-a460-98f7df86f891): created successfully Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5f81350-ec4e-47d4-a576-1287744750bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Flow 'volume_create_manager' (1009b7e2-14a5-4bcb-ac35-1b277c1af88f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c9d87096-4ed5-44ce-adb1-c75023d5d806 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Created volume successfully. Sep 01 02:23:08 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d Sep 01 02:23:08 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd9d9f23-89fc-4dcb-a6a4-c765b1770251" returned: 0 in 0.359s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-fd9d9f23-89fc-4dcb-a6a4-c765b1770251" released by "delete_volume" :: held 0.980s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:08 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 1073741824" returned: 0 in 0.610s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Created reservations ['67e89800-35c9-4461-8c3f-da7caa802853', '276025fa-1840-4ac0-81ef-5d0e16475e64', 'a8932a43-fb9b-4be6-86cb-1795bd0875a8', '76e7bec0-3922-4d8c-b203-394d353a0df0'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:08 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 Sep 01 02:23:08 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:08 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d" returned: 0 in 0.419s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d Sep 01 02:23:08 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0" returned: 0 in 0.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.048s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145349127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7deec23b-13a1-4c59-80d8-8c62ce743620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b11309d252f4e76b34ac20fe74a47a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:04Z,use_quota=True,user_id='b08b738655834f6d9dd93bd4ce32ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Creating volume 7deec23b-13a1-4c59-80d8-8c62ce743620 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:08 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 1073741824 Sep 01 02:23:08 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee733507-a42c-4eb2-a553-2fed06f58030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32357e23-a80a-4c5a-b4e4-5520b6fcc1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:08 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 (88d09c9f-e36d-40b5-8422-0a8b984c74d0): created successfully Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32357e23-a80a-4c5a-b4e4-5520b6fcc1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (1e08b5e0-836e-4b34-ab3d-1851393e122d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c9167732-cc42-42aa-b04c-5fb37c88eea4 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created volume successfully. Sep 01 02:23:08 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.293s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:08 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Deleted volume successfully. Sep 01 02:23:08 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-069c131d-a77d-4ccb-aef9-950a156603bc tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-fd9d9f23-89fc-4dcb-a6a4-c765b1770251-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f7153d7b-8058-4d20-a8ee-529483fa9e3d" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Lock "cinder-quobyte-f7153d7b-8058-4d20-a8ee-529483fa9e3d" released by "delete_volume" :: held 0.755s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Created reservations ['ba1a3d18-4c77-4598-9f08-bec92db1f4bf', 'bfc656fa-6df2-4252-b064-dd1502b14231', '87320c11-ed4e-4e16-8b99-f6daac558c66', '95bc8228-6edc-4e74-a700-cde22a458c87'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:08 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Acquiring lock "cinder-b44fef34-a8ef-4694-a460-98f7df86f891-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "cinder-b44fef34-a8ef-4694-a460-98f7df86f891-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Acquiring lock "cinder-quobyte-b44fef34-a8ef-4694-a460-98f7df86f891" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:09 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 1073741824" returned: 0 in 0.637s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "cinder-quobyte-b44fef34-a8ef-4694-a460-98f7df86f891" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:09 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0f5380-455e-483f-9fdf-6af8379beb96]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Deleted volume successfully. Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-10712300-ebb7-459a-a526-8427e27ce6e5 tempest-VolumeImageDependencyTests-1136320741 None] Lock "cinder-f7153d7b-8058-4d20-a8ee-529483fa9e3d-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:09 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 Sep 01 02:23:09 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 Sep 01 02:23:09 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-0b2d6b6e-6d7c-41fa-a769-876744a0f51e-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-0b2d6b6e-6d7c-41fa-a769-876744a0f51e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-quobyte-0b2d6b6e-6d7c-41fa-a769-876744a0f51e" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-0b2d6b6e-6d7c-41fa-a769-876744a0f51e" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf46813b-dd39-4bc6-aa67-f91c02c18dfb]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620" returned: 0 in 0.427s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:09 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e Sep 01 02:23:09 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25fa218-9a47-4f26-b5cb-2a74d54340a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7deec23b-13a1-4c59-80d8-8c62ce743620', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1143573-da4c-493a-b926-12a0582404c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:09 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891" returned: 0 in 0.510s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Volume volume-7deec23b-13a1-4c59-80d8-8c62ce743620 (7deec23b-13a1-4c59-80d8-8c62ce743620): created successfully Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1143573-da4c-493a-b926-12a0582404c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:09 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891 Sep 01 02:23:09 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Flow 'volume_create_manager' (1afdb987-0ae8-411b-8fae-722707719809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4641acde-a048-4707-8d12-dc834c733a69 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created volume successfully. Sep 01 02:23:10 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b44fef34-a8ef-4694-a460-98f7df86f891" returned: 0 in 0.284s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e" returned: 0 in 0.445s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "cinder-quobyte-b44fef34-a8ef-4694-a460-98f7df86f891" released by "delete_volume" :: held 0.865s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:10 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e Sep 01 02:23:10 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Created reservations ['e16a9851-9841-46c0-8c52-74dc17b53efe', '3b94fe16-0e63-46e8-bba9-49c24abcd976', '8230b886-34d9-43a0-b30d-db5ec2197062', '3d05be7b-5601-4755-982a-7849b4772981'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-7deec23b-13a1-4c59-80d8-8c62ce743620-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-7deec23b-13a1-4c59-80d8-8c62ce743620-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:10 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-quobyte-7deec23b-13a1-4c59-80d8-8c62ce743620" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-7deec23b-13a1-4c59-80d8-8c62ce743620" acquired by "delete_volume" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9232db2-c71e-4797-bf95-f3f04f926b5d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0b2d6b6e-6d7c-41fa-a769-876744a0f51e" returned: 0 in 0.438s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-0b2d6b6e-6d7c-41fa-a769-876744a0f51e" released by "delete_volume" :: held 0.936s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Created reservations ['5c4520e3-f2f0-42bc-8ea8-b4d71deb6b71', '2b9faccd-ce5f-44e7-a981-cfd86e08d1c7', '54195167-ad16-4adb-825d-5719f55c849e', 'b7abfb02-1b8e-4de6-90ff-abbad72d4b46'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:10 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 Sep 01 02:23:10 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Deleted volume successfully. Sep 01 02:23:10 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:10 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a8bc3f50-a76e-4efa-80e6-619ca0bcce22 tempest-VolumeAndVolumeTypeFromImageTest-722645194 None] Lock "cinder-b44fef34-a8ef-4694-a460-98f7df86f891-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:11 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.300s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Deleted volume successfully. Sep 01 02:23:11 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620" returned: 0 in 0.578s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a283d224-1635-4b8b-a007-5943c148154b tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-0b2d6b6e-6d7c-41fa-a769-876744a0f51e-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:11 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620 Sep 01 02:23:11 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:11 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7deec23b-13a1-4c59-80d8-8c62ce743620" returned: 0 in 0.308s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-7deec23b-13a1-4c59-80d8-8c62ce743620" released by "delete_volume" :: held 0.950s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created reservations ['664b7f24-85a7-451a-be51-821d3afd63a7', '9b53cb96-0f1e-4c05-bec7-a119ba108176', 'ee1abf35-869f-46bb-befd-bb579b3f03f2', '17054764-5bac-447f-90c1-0a79dd9f0843'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:11 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:11 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-4e040cb7-acd4-4b3a-995c-b657f9d985e7-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-4e040cb7-acd4-4b3a-995c-b657f9d985e7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:11 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "cinder-quobyte-4e040cb7-acd4-4b3a-995c-b657f9d985e7" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.364s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:11 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Deleted volume successfully. Sep 01 02:23:11 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-4e040cb7-acd4-4b3a-995c-b657f9d985e7" acquired by "delete_volume" :: waited 0.037s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1d703b84-07b3-46d8-9eb9-d9acdee45734 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-7deec23b-13a1-4c59-80d8-8c62ce743620-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcba40b-6534-4f32-b11d-764bf4e252bd]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:12 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 Sep 01 02:23:12 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:12 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7" returned: 0 in 0.439s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:12 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7 Sep 01 02:23:12 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:12 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4e040cb7-acd4-4b3a-995c-b657f9d985e7" returned: 0 in 0.301s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-quobyte-4e040cb7-acd4-4b3a-995c-b657f9d985e7" released by "delete_volume" :: held 0.795s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Created reservations ['8637e8f5-3d29-4152-a4bd-7d22e471d1eb', 'ebb3f0c1-1071-42f4-8c37-178803f6e503', '62591298-7c6d-4aff-94c4-afbb694d87be', 'b08b7abe-37fd-4ed2-93d4-e4a9de2eab73'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-88d09c9f-e36d-40b5-8422-0a8b984c74d0-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-88d09c9f-e36d-40b5-8422-0a8b984c74d0-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:13 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:13 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-quobyte-88d09c9f-e36d-40b5-8422-0a8b984c74d0" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-88d09c9f-e36d-40b5-8422-0a8b984c74d0" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1fea9f-a5fe-46fe-b69d-a79700a40407]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:13 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 Sep 01 02:23:13 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:13 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.311s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Deleted volume successfully. Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-cb52c761-eba9-4f81-bf8a-2ef214a5e0eb tempest-CreateVolumesFromImageTest-1245275982 None] Lock "cinder-4e040cb7-acd4-4b3a-995c-b657f9d985e7-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:13 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0" returned: 0 in 0.451s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:13 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0 Sep 01 02:23:13 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:13 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-88d09c9f-e36d-40b5-8422-0a8b984c74d0" returned: 0 in 0.332s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-88d09c9f-e36d-40b5-8422-0a8b984c74d0" released by "delete_volume" :: held 0.844s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created reservations ['fb5229db-1729-4fce-85da-db7874fb2551', 'df0282dc-4934-4a1b-bc9d-021f5740ccb9', '5941fb92-0dc8-41c0-837a-e0488ed8aca5', '05abb494-b572-40e4-b626-590ec9364b8e'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:14 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:14 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-d2988069-7e72-40bf-a684-9302b5a60854 tempest-ProjectAdminTests-1486010379 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0264511108398, 'free_capacity_gb': 1774.0264511108398, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87425) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:23:14 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.383s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:14 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Deleted volume successfully. Sep 01 02:23:14 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-0c953529-6fff-4a65-b3cd-cbc7b32bb8a5 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-88d09c9f-e36d-40b5-8422-0a8b984c74d0-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-438ea142-09bd-443b-b718-d97902ed5ef0-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-438ea142-09bd-443b-b718-d97902ed5ef0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-quobyte-438ea142-09bd-443b-b718-d97902ed5ef0" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:15 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-438ea142-09bd-443b-b718-d97902ed5ef0" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:15 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d14ccc-41bc-4ccf-b810-98bbe133e8b8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:15 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 Sep 01 02:23:15 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:15 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0" returned: 0 in 0.464s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:15 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0 Sep 01 02:23:15 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:16 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-438ea142-09bd-443b-b718-d97902ed5ef0" returned: 0 in 0.370s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-438ea142-09bd-443b-b718-d97902ed5ef0" released by "delete_volume" :: held 0.884s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created reservations ['4e6e9a57-940e-4a10-89ee-692ff1fccbb9', '5f6d9caf-d55c-4341-821b-bbc1a9db302a', 'a3f225a7-eff3-483d-948e-c4c8f8dc7bbe', '39f80b84-b284-4ad3-9d87-8fb743879b7d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:16 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:16 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-4f4a799f-918a-4853-97cc-1a829d05ca40-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-4f4a799f-918a-4853-97cc-1a829d05ca40-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-quobyte-4f4a799f-918a-4853-97cc-1a829d05ca40" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-4f4a799f-918a-4853-97cc-1a829d05ca40" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bafb697-b288-43a3-bd62-4267552c0798]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:16 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.370s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:16 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Deleted volume successfully. Sep 01 02:23:16 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-632b4ccc-0b19-4cc8-8109-84de44b5913e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-438ea142-09bd-443b-b718-d97902ed5ef0-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:16 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 Sep 01 02:23:16 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:17 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40" returned: 0 in 0.579s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:17 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40 Sep 01 02:23:17 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:17 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f4a799f-918a-4853-97cc-1a829d05ca40" returned: 0 in 0.307s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-4f4a799f-918a-4853-97cc-1a829d05ca40" released by "delete_volume" :: held 0.971s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created reservations ['6eda03d1-0564-4870-809d-27587aa2fbcc', '5e0ad80b-abd9-419c-bcb6-829e807e1753', 'f836cf9f-24f3-4a01-a3bc-0b15d0e23fb7', '769cf5b4-51bf-454c-b6f3-7acee3c4ef2c'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:17 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:17 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:18 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.368s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:18 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Deleted volume successfully. Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (6da9cfa9-8dc1-4b99-acf5-4a0c0d73cbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b45a70c-6bae-4e90-b170-b7dea06d3502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f340e1fa-ebd8-4a23-8142-ebee9847b00b tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-4f4a799f-918a-4853-97cc-1a829d05ca40-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b45a70c-6bae-4e90-b170-b7dea06d3502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761077064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b633c1d9-d379-4742-96e1-e71897b70bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:18Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e364b97a-9e6e-47de-b897-857fe7a3a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e364b97a-9e6e-47de-b897-857fe7a3a33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d732296f-e8d4-4a03-aef8-4ba6fc05d879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d732296f-e8d4-4a03-aef8-4ba6fc05d879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b633c1d9-d379-4742-96e1-e71897b70bd1', 'volume_name': 'volume-b633c1d9-d379-4742-96e1-e71897b70bd1', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c7abf5-bf55-4999-a031-22185c5f64a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c7abf5-bf55-4999-a031-22185c5f64a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7cefe6-afec-43d2-8107-a38827185089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:18 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume b633c1d9-d379-4742-96e1-e71897b70bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b633c1d9-d379-4742-96e1-e71897b70bd1', 'volume_size': 1} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761077064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b633c1d9-d379-4742-96e1-e71897b70bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:18Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Creating volume b633c1d9-d379-4742-96e1-e71897b70bd1 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:18 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:18 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 1073741824 Sep 01 02:23:18 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-398a03c9-ee76-47f3-a096-69b1343c0aea-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-398a03c9-ee76-47f3-a096-69b1343c0aea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:18 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 1073741824" returned: 0 in 0.598s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-quobyte-398a03c9-ee76-47f3-a096-69b1343c0aea" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-398a03c9-ee76-47f3-a096-69b1343c0aea" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db5a032-239c-4078-ac83-13969a4b179e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 Sep 01 02:23:19 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea Sep 01 02:23:19 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1" returned: 0 in 0.399s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7cefe6-afec-43d2-8107-a38827185089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b633c1d9-d379-4742-96e1-e71897b70bd1', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3431913d-4f08-44b5-9091-96df730d74ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume volume-b633c1d9-d379-4742-96e1-e71897b70bd1 (b633c1d9-d379-4742-96e1-e71897b70bd1): created successfully Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3431913d-4f08-44b5-9091-96df730d74ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (6da9cfa9-8dc1-4b99-acf5-4a0c0d73cbcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ac8358cb-5db0-47ea-b01f-8a8c2e769fc5 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created volume successfully. Sep 01 02:23:19 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea" returned: 0 in 0.497s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea Sep 01 02:23:19 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-398a03c9-ee76-47f3-a096-69b1343c0aea" returned: 0 in 0.277s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-398a03c9-ee76-47f3-a096-69b1343c0aea" released by "delete_volume" :: held 0.837s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created reservations ['0bdf4a62-e086-4532-a84a-69ce1f8d6442', '7f688239-0d17-4723-9378-e70df09d33f2', '28dfd3a7-9918-40fc-978a-abac8b654757', '082a160d-527e-4380-872c-7fea3be74d2d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:19 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-b7a3f72f-692e-4b6a-8c75-846344a1d2eb-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-b7a3f72f-692e-4b6a-8c75-846344a1d2eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-quobyte-a69f4765-b9c0-432f-bc97-58ab8e310a5f" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-a69f4765-b9c0-432f-bc97-58ab8e310a5f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-quobyte-b7a3f72f-692e-4b6a-8c75-846344a1d2eb" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-b7a3f72f-692e-4b6a-8c75-846344a1d2eb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Deleting offline snapshot b7a3f72f-692e-4b6a-8c75-846344a1d2eb of volume a69f4765-b9c0-432f-bc97-58ab8e310a5f {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] snapshot_file for this snap is: volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba3402-c4c7-40e8-9f94-bfba4e88ca11]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:20 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Deleted volume successfully. Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c5cc25fa-454c-4124-b958-e4552771dd82 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-398a03c9-ee76-47f3-a096-69b1343c0aea-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:20 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb Sep 01 02:23:20 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb" returned: 0 in 0.590s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aecc83-6145-4ded-8c58-5d900d34e7dc]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f Sep 01 02:23:21 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (b8f3975b-f3d9-415f-88cc-8b5c1a411357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647bd759-a320-4578-a4b4-fbcf80861c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f" returned: 0 in 0.659s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647bd759-a320-4578-a4b4-fbcf80861c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737177609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd7b3ee-95ed-4542-b78c-2b24b23a707a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:21Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82708d67-c6d3-403d-a0ac-3bb81e2e0966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:21 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb Sep 01 02:23:21 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82708d67-c6d3-403d-a0ac-3bb81e2e0966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f8eb38-c440-48ec-8c88-2d9dc8172b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11f8eb38-c440-48ec-8c88-2d9dc8172b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd7b3ee-95ed-4542-b78c-2b24b23a707a', 'volume_name': 'volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abdb4d0-ac48-4a09-add1-01c582679594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7abdb4d0-ac48-4a09-add1-01c582679594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd911929-8687-482f-b908-d4d281c36b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:21 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume dcd7b3ee-95ed-4542-b78c-2b24b23a707a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a', 'volume_size': 1} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1737177609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd7b3ee-95ed-4542-b78c-2b24b23a707a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:21Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Creating volume dcd7b3ee-95ed-4542-b78c-2b24b23a707a {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:21 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a 1073741824 Sep 01 02:23:21 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (e3232aa1-a4e5-47e6-962b-0a86b0c0f0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b9b568-5c6d-422b-aa3d-f5546b850580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b9b568-5c6d-422b-aa3d-f5546b850580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1613742727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51292d50-c58f-49f2-8f79-1faf5c4f2cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:22Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d003dfd-e9ae-4f23-a496-dd2949a5b248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d003dfd-e9ae-4f23-a496-dd2949a5b248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ffceb1-3c80-4828-bd8d-3ea1f647231b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ffceb1-3c80-4828-bd8d-3ea1f647231b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51292d50-c58f-49f2-8f79-1faf5c4f2cde', 'volume_name': 'volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cce7d2-1fdd-4e32-82e5-7d672fa257fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cce7d2-1fdd-4e32-82e5-7d672fa257fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52343485-ed8a-47e9-b5ca-cb908eec471b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume 51292d50-c58f-49f2-8f79-1faf5c4f2cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde', 'volume_size': 1} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb" returned: 0 in 0.701s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:22 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb Sep 01 02:23:22 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (3e563c9a-930d-4253-ab75-8acad89fa4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388c74c7-cc61-414c-83cc-383f30cc7250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a 1073741824" returned: 0 in 0.807s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:22 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388c74c7-cc61-414c-83cc-383f30cc7250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585600473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f61eb5-3ce7-432b-aac7-9b12ed3dc574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:22Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d1bc6f-70a2-4d99-99b2-4d8b0cfa5f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d1bc6f-70a2-4d99-99b2-4d8b0cfa5f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5882dbb0-48ee-4dce-8225-0d15ce88df43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5882dbb0-48ee-4dce-8225-0d15ce88df43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f61eb5-3ce7-432b-aac7-9b12ed3dc574', 'volume_name': 'volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cc0d02-9159-4953-b8ae-34f33294e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98cc0d02-9159-4953-b8ae-34f33294e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b1f74f-a2a3-4196-8d2d-3e40d5c60006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume 46f61eb5-3ce7-432b-aac7-9b12ed3dc574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574', 'volume_size': 1} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:22 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a Sep 01 02:23:22 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:22 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f.b7a3f72f-692e-4b6a-8c75-846344a1d2eb" returned: 0 in 0.552s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-b7a3f72f-692e-4b6a-8c75-846344a1d2eb" released by "_delete_snapshot" :: held 2.706s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-a69f4765-b9c0-432f-bc97-58ab8e310a5f" released by "delete_snapshot" :: held 2.752s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (c067f788-d8bd-4c12-b48c-d1df711561fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3f990a-3e51-4393-8459-8cc863579150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d3f990a-3e51-4393-8459-8cc863579150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601817554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f0f568-cfe2-433d-91c5-211a6b01d5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:23Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1602d0d3-ddbc-4518-afdb-d7e46ec199d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1602d0d3-ddbc-4518-afdb-d7e46ec199d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd06064b-b4b4-4a74-adbc-9d2131757298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:22 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd06064b-b4b4-4a74-adbc-9d2131757298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f0f568-cfe2-433d-91c5-211a6b01d5a8', 'volume_name': 'volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15b754f-e8d7-4522-9b1d-33ab18fc2d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15b754f-e8d7-4522-9b1d-33ab18fc2d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d3188a-0efd-4b8a-baa0-535dab772791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume c6f0f568-cfe2-433d-91c5-211a6b01d5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8', 'volume_size': 1} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:23 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a" returned: 0 in 0.496s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.900s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1613742727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51292d50-c58f-49f2-8f79-1faf5c4f2cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:22Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Creating volume 51292d50-c58f-49f2-8f79-1faf5c4f2cde {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:23 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd911929-8687-482f-b908-d4d281c36b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:23 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde 1073741824 Sep 01 02:23:23 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d660e32-0f50-4ded-8f75-aa41582b6731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created reservations ['d787092e-dc7a-4da2-8e6b-1a5e84869362', 'ceabe147-f839-4f55-a380-4537f38fb45f', 'dc154f3b-2d7f-45c2-b96c-134e9625c13f', 'a1630d02-86cb-4f31-9cbf-01a0e64f7277'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a (dcd7b3ee-95ed-4542-b78c-2b24b23a707a): created successfully Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d660e32-0f50-4ded-8f75-aa41582b6731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (b8f3975b-f3d9-415f-88cc-8b5c1a411357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9565bb25-6687-458b-9e3e-4385a9811c9a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created volume successfully. Sep 01 02:23:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Delete snapshot completed successfully. Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-300487b3-c887-4b36-8fea-3c0e5216643e tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-b7a3f72f-692e-4b6a-8c75-846344a1d2eb-delete_snapshot" released by "delete_snapshot" :: held 3.277s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (4b41eb2b-d388-4b25-91d2-2afb90bf9437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ea946b-b971-432b-a620-f147a571850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ea946b-b971-432b-a620-f147a571850a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128557806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:24Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56deeb5f-f093-46b8-b9de-e446ec0f2d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56deeb5f-f093-46b8-b9de-e446ec0f2d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77adfe5-08d5-43bf-85b3-6881a387c362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f77adfe5-08d5-43bf-85b3-6881a387c362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16', 'volume_name': 'volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3671e225-e236-4cce-9066-002a41de1e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3671e225-e236-4cce-9066-002a41de1e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5f2203-b141-47b8-a96d-29ed7718ff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16', 'volume_size': 1} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-a69f4765-b9c0-432f-bc97-58ab8e310a5f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:23 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde 1073741824" returned: 0 in 0.699s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-a69f4765-b9c0-432f-bc97-58ab8e310a5f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "cinder-quobyte-a69f4765-b9c0-432f-bc97-58ab8e310a5f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:23 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde Sep 01 02:23:23 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-a69f4765-b9c0-432f-bc97-58ab8e310a5f" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df8feda-61b8-4ace-9e45-68c0037f7165]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f Sep 01 02:23:24 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde" returned: 0 in 0.303s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.666s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585600473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f61eb5-3ce7-432b-aac7-9b12ed3dc574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:22Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Creating volume 46f61eb5-3ce7-432b-aac7-9b12ed3dc574 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:24 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52343485-ed8a-47e9-b5ca-cb908eec471b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfac1d2-477f-41c5-84e5-2c96f191395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:24 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 1073741824 Sep 01 02:23:24 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde (51292d50-c58f-49f2-8f79-1faf5c4f2cde): created successfully Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfac1d2-477f-41c5-84e5-2c96f191395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (e3232aa1-a4e5-47e6-962b-0a86b0c0f0e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:24 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-40ffef88-3148-4c33-8aea-172d69555922 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created volume successfully. Sep 01 02:23:24 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f" returned: 0 in 0.440s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f Sep 01 02:23:24 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 1073741824" returned: 0 in 0.576s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a69f4765-b9c0-432f-bc97-58ab8e310a5f" returned: 0 in 0.323s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-quobyte-a69f4765-b9c0-432f-bc97-58ab8e310a5f" released by "delete_volume" :: held 0.872s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 Sep 01 02:23:24 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Created reservations ['02803af0-3888-4e36-aa4d-f30fe2172869', 'bc2729c7-b978-442f-819c-d4b833d64ddf', '5133ffb6-089e-4155-97b7-9a3bbbcc922a', 'e7f83014-8e8f-4a64-bb29-9859343f9019'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:24 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (80e74e3c-c2fb-4958-8c88-be21f02c77d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28fa037-ae67-4a3d-9fd2-4797bae4a370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28fa037-ae67-4a3d-9fd2-4797bae4a370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-860805747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4149b49-e2f6-4529-9d8e-eb3749b375b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:25Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4e25b9-f9c2-44f1-bed1-94b401c84852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf4e25b9-f9c2-44f1-bed1-94b401c84852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2382733e-5844-40b9-8381-d79c105ae8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2382733e-5844-40b9-8381-d79c105ae8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4149b49-e2f6-4529-9d8e-eb3749b375b2', 'volume_name': 'volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78a4c9a-a858-403e-8fb8-3ae578e65187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f78a4c9a-a858-403e-8fb8-3ae578e65187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4370c3de-7f5c-4aa7-8621-0e6555d2d4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:25 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Volume b4149b49-e2f6-4529-9d8e-eb3749b375b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2', 'volume_size': 1} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:25 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.120s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-601817554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f0f568-cfe2-433d-91c5-211a6b01d5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:23Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Creating volume c6f0f568-cfe2-433d-91c5-211a6b01d5a8 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:25 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:25 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:25 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b1f74f-a2a3-4196-8d2d-3e40d5c60006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:25 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 1073741824 Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a64385e-2557-4ebb-bd5d-c0ce4781b43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:25 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:25 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 (46f61eb5-3ce7-432b-aac7-9b12ed3dc574): created successfully Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a64385e-2557-4ebb-bd5d-c0ce4781b43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (3e563c9a-930d-4253-ab75-8acad89fa4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c2c93e06-5f6d-4e40-8155-bbe232acaf25 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created volume successfully. Sep 01 02:23:25 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.295s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Deleted volume successfully. Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b39287ea-a769-484f-a8d0-9eeb9eb65b52 tempest-CreateVolumesFromSnapshotTest-1471881094 None] Lock "cinder-a69f4765-b9c0-432f-bc97-58ab8e310a5f-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:25 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 1073741824" returned: 0 in 0.490s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:25 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 Sep 01 02:23:25 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:26 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8" returned: 0 in 0.318s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128557806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf3f63f04a647f899cfc4920a4e9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:24Z,use_quota=True,user_id='7be44dfcd4444a87892e4c84838ab276',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Creating volume c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:26 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d3188a-0efd-4b8a-baa0-535dab772791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df0b65d-7586-4d3e-9f53-7093e94e4bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:26 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 1073741824 Sep 01 02:23:26 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:26 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 (c6f0f568-cfe2-433d-91c5-211a6b01d5a8): created successfully Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df0b65d-7586-4d3e-9f53-7093e94e4bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (c067f788-d8bd-4c12-b48c-d1df711561fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:26 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3db55b6b-d340-4223-9a5e-7fbc65ebf71a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created volume successfully. Sep 01 02:23:26 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 1073741824" returned: 0 in 0.503s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:26 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 Sep 01 02:23:26 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:26 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16" returned: 0 in 0.303s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-860805747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4149b49-e2f6-4529-9d8e-eb3749b375b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:25Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Creating volume b4149b49-e2f6-4529-9d8e-eb3749b375b2 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:26 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5f2203-b141-47b8-a96d-29ed7718ff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7385660d-5203-4156-b7d9-aa59a656128b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:26 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 1073741824 Sep 01 02:23:26 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:26 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Volume volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 (c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16): created successfully Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7385660d-5203-4156-b7d9-aa59a656128b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:26 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Flow 'volume_create_manager' (4b41eb2b-d388-4b25-91d2-2afb90bf9437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f828acb9-b623-4026-94ab-f9b784e83342 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created volume successfully. Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-quobyte-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[321da0c1-b5fe-418a-a7c9-5973e6fcb66e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:27 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 Sep 01 02:23:27 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:27 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 1073741824" returned: 0 in 0.677s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:27 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 Sep 01 02:23:27 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:27 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16" returned: 0 in 0.525s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:27 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16 Sep 01 02:23:27 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:27 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2" returned: 0 in 0.327s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4370c3de-7f5c-4aa7-8621-0e6555d2d4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8cc55a-3332-435d-99cc-1a16aeeac7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:28 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Volume volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 (b4149b49-e2f6-4529-9d8e-eb3749b375b2): created successfully Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db8cc55a-3332-435d-99cc-1a16aeeac7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (80e74e3c-c2fb-4958-8c88-be21f02c77d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:28 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c8c0ca72-32f2-445b-900f-a059a5718e38 tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:23:28 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16" returned: 0 in 0.321s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16" released by "delete_volume" :: held 0.903s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created reservations ['4ca1d85c-774e-46b8-a6d1-99527d66860b', 'c0b53332-9c6e-4b19-b230-1e61a1b7851d', '0f4bad35-516a-49a7-8ace-f278a4e3d7ab', '328e7f4a-e4b2-40c7-a1f9-507715303374'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:28 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-c6f0f568-cfe2-433d-91c5-211a6b01d5a8-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-c6f0f568-cfe2-433d-91c5-211a6b01d5a8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-quobyte-c6f0f568-cfe2-433d-91c5-211a6b01d5a8" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-c6f0f568-cfe2-433d-91c5-211a6b01d5a8" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3975004a-5619-439f-8253-e27beb33d770]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 Sep 01 02:23:28 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.404s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:28 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Deleted volume successfully. Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-401aa9d9-b67b-4587-a042-68886a4de8cd tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-c6c1e1c6-3e2f-4cf0-bd21-43a7d05acf16-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Creating offline snapshot 26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c of volume b4149b49-e2f6-4529-9d8e-eb3749b375b2 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0bdbbc-5c10-4da6-aa19-d4f36b3f1048]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 Sep 01 02:23:29 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8" returned: 0 in 0.552s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8 Sep 01 02:23:29 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2" returned: 0 in 0.495s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c 1G Sep 01 02:23:29 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6f0f568-cfe2-433d-91c5-211a6b01d5a8" returned: 0 in 0.347s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-c6f0f568-cfe2-433d-91c5-211a6b01d5a8" released by "delete_volume" :: held 0.969s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created reservations ['e084f5ef-4196-4b29-8fdb-c23698224649', '9f260864-9957-46a3-bbde-4c5346272f00', 'ca43e139-edfa-40d9-bf0d-0dab4904c54f', '0fe46b04-7a91-4436-a92e-ae2a5ad115e1'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:29 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c 1G" returned: 0 in 0.618s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:30 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c Sep 01 02:23:30 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.372s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Deleted volume successfully. Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3a78d4a7-aa11-4d96-ac56-9018d7c328e6 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-c6f0f568-cfe2-433d-91c5-211a6b01d5a8-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:30 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Flow 'volume_create_manager' (6c5daffe-e40e-4e29-bd3e-f698b8de8f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d3c892-f695-4dd7-b001-0bdd8260ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c" returned: 0 in 0.380s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c is being set with open permissions: ugo+rw Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d3c892-f695-4dd7-b001-0bdd8260ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-821779311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c25a089-958c-4c6e-8b2c-aa6727a5dcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949d4e45edd6466089e2f3f7dcf58684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:30Z,use_quota=True,user_id='813f8a1a001a471e8b34c76f079e6a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:30 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c Sep 01 02:23:30 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0507cafe-e35b-4278-8219-657212dbd1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0507cafe-e35b-4278-8219-657212dbd1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9c6939-c824-4ae5-8915-1ffee798869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9c6939-c824-4ae5-8915-1ffee798869a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c25a089-958c-4c6e-8b2c-aa6727a5dcc1', 'volume_name': 'volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e572d53-7da1-45a4-951b-516d042a773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e572d53-7da1-45a4-951b-516d042a773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246bb6f7-4a29-47c4-9f2c-94e7945cc141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:30 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Volume 6c25a089-958c-4c6e-8b2c-aa6727a5dcc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1', 'volume_size': 1} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:30 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c" returned: 0 in 0.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-46f61eb5-3ce7-432b-aac7-9b12ed3dc574-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-46f61eb5-3ce7-432b-aac7-9b12ed3dc574-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:30 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.info Sep 01 02:23:30 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-quobyte-46f61eb5-3ce7-432b-aac7-9b12ed3dc574" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-46f61eb5-3ce7-432b-aac7-9b12ed3dc574" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:30 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89de54-1836-44f7-a1f6-dc3dfbe247db]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:31 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 Sep 01 02:23:31 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:31 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.info" returned: 0 in 0.319s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:31 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.info is being set with open permissions: ugo+rw Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:31 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.info Sep 01 02:23:31 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574" returned: 0 in 0.453s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:31 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:31 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574 Sep 01 02:23:31 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:31 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.info" returned: 0 in 0.320s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-821779311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c25a089-958c-4c6e-8b2c-aa6727a5dcc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949d4e45edd6466089e2f3f7dcf58684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:30Z,use_quota=True,user_id='813f8a1a001a471e8b34c76f079e6a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Creating volume 6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:31 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:31 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 1073741824 Sep 01 02:23:31 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4ad1be98-801b-4026-8676-eea3ca31a52b tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:23:31 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-46f61eb5-3ce7-432b-aac7-9b12ed3dc574" returned: 0 in 0.324s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-46f61eb5-3ce7-432b-aac7-9b12ed3dc574" released by "delete_volume" :: held 0.824s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created reservations ['3646a3ca-7c43-43bd-85f4-f19bd30bf517', 'fefa6b1c-6a32-4b8a-a8ba-b675ccfc53e5', 'a5ef8213-5c0f-4aa0-8505-7495f4780d93', '4ed1e614-205c-4af9-b999-58677e9a738a'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:31 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:31 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-51292d50-c58f-49f2-8f79-1faf5c4f2cde-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-51292d50-c58f-49f2-8f79-1faf5c4f2cde-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-quobyte-51292d50-c58f-49f2-8f79-1faf5c4f2cde" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:32 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 1073741824" returned: 0 in 0.608s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-51292d50-c58f-49f2-8f79-1faf5c4f2cde" acquired by "delete_volume" :: waited 0.033s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-b4149b49-e2f6-4529-9d8e-eb3749b375b2" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c75da7-d1e9-48ae-8951-a5aa82968e10]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 Sep 01 02:23:32 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b4149b49-e2f6-4529-9d8e-eb3749b375b2" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot 26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c of volume b4149b49-e2f6-4529-9d8e-eb3749b375b2 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4f1e24-5d7d-47f0-adf4-73e3b4b948e9]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.460s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Deleted volume successfully. Sep 01 02:23:32 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde Sep 01 02:23:32 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-293e11f5-e653-4016-b8f9-88a2a2709a1a tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-46f61eb5-3ce7-432b-aac7-9b12ed3dc574-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:32 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c Sep 01 02:23:32 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:32 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" returned: 0 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246bb6f7-4a29-47c4-9f2c-94e7945cc141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5c392a-d935-4456-9858-729d4bafdaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:32 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Volume volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 (6c25a089-958c-4c6e-8b2c-aa6727a5dcc1): created successfully Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5c392a-d935-4456-9858-729d4bafdaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Flow 'volume_create_manager' (6c5daffe-e40e-4e29-bd3e-f698b8de8f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:32 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde" returned: 0 in 0.544s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-66f6274e-af8e-4f07-8b67-739931fa2d1c tempest-VolumeDependencyTests-595576352 None] Created volume successfully. Sep 01 02:23:32 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde Sep 01 02:23:32 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:32 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c" returned: 0 in 0.589s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6501c-b160-4329-a6e9-7e61bdb23f10]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:33 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-51292d50-c58f-49f2-8f79-1faf5c4f2cde" returned: 0 in 0.327s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-51292d50-c58f-49f2-8f79-1faf5c4f2cde" released by "delete_volume" :: held 0.963s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:33 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created reservations ['c6184bca-b689-4408-8464-e525307c143f', '237965b2-0977-4cd0-bf19-1a766582045d', 'c4be5ca0-2047-4390-999a-eec1f023071c', 'f89b7f01-c1b9-4bc5-95b3-a80aecc27436'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:33 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:33 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2" returned: 0 in 0.463s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:33 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c Sep 01 02:23:33 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.295s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:33 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Deleted volume successfully. Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-c527ad06-a6f5-4484-9032-7688a3202857 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-51292d50-c58f-49f2-8f79-1faf5c4f2cde-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:33 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c" returned: 0 in 0.491s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:34 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c Sep 01 02:23:34 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Creating offline snapshot 37a37f27-01e7-4356-931e-c6395e921eb9 of volume 6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a32998d-ae78-4733-92c7-d863671b14d4]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 Sep 01 02:23:34 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2.26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c" returned: 0 in 0.303s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c" released by "_delete_snapshot" :: held 2.022s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b4149b49-e2f6-4529-9d8e-eb3749b375b2" released by "delete_snapshot" :: held 2.063s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-dcd7b3ee-95ed-4542-b78c-2b24b23a707a-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-dcd7b3ee-95ed-4542-b78c-2b24b23a707a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-quobyte-dcd7b3ee-95ed-4542-b78c-2b24b23a707a" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:34 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" returned: 0 in 0.470s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Created reservations ['37766651-deec-4fe9-9c37-0f32164faa21', '30fd3078-8898-4776-afe8-34d65785e46d', 'bcf94245-e28c-4fa3-b8f1-1c515749b68c', '0f317784-4481-46c8-a896-7a9f5b52ddeb'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-dcd7b3ee-95ed-4542-b78c-2b24b23a707a" acquired by "delete_volume" :: waited 0.046s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:34 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 1G Sep 01 02:23:34 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7066ba-3d30-494c-9c29-322b55e2362b]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:23:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fcd9570f-8eab-4e45-8c82-1d77a27cbeb6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-26974f2f-5b8a-4bdf-bac1-0cd8cb9d049c-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:34 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a Sep 01 02:23:34 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 1G" returned: 0 in 0.503s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a" returned: 0 in 0.445s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 Sep 01 02:23:35 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a Sep 01 02:23:35 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-dcd7b3ee-95ed-4542-b78c-2b24b23a707a" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-dcd7b3ee-95ed-4542-b78c-2b24b23a707a" released by "delete_volume" :: held 0.781s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:35 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9" returned: 0 in 0.325s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 is being set with open permissions: ugo+rw Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 Sep 01 02:23:35 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created reservations ['81ddc86c-15b2-4adf-b6fe-0f8965268d9a', '2404527c-0c4e-4980-874a-f231834e4ee6', '825809ec-f3e8-4609-b3c7-053907430cba', 'ae31ba6f-1c75-40f0-b891-ab13a9133500'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:35 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-b4149b49-e2f6-4529-9d8e-eb3749b375b2-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Lock "cinder-b4149b49-e2f6-4529-9d8e-eb3749b375b2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-b633c1d9-d379-4742-96e1-e71897b70bd1-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:35 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-b4149b49-e2f6-4529-9d8e-eb3749b375b2" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9" returned: 0 in 0.415s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-b633c1d9-d379-4742-96e1-e71897b70bd1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b4149b49-e2f6-4529-9d8e-eb3749b375b2" acquired by "delete_volume" :: waited 0.051s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[903bee74-3bcf-4355-af24-ecc55e688f04]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "cinder-quobyte-b633c1d9-d379-4742-96e1-e71897b70bd1" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-b633c1d9-d379-4742-96e1-e71897b70bd1" acquired by "delete_volume" :: waited 0.045s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:35 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.info Sep 01 02:23:35 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.487s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Deleted volume successfully. Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[93628aec-eeb0-4d07-a1b2-63bdafbf9449]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 Sep 01 02:23:36 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3f60b1ac-2fbc-42b9-8b4d-39fd43759521 tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-dcd7b3ee-95ed-4542-b78c-2b24b23a707a-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:36 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 Sep 01 02:23:36 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.info" returned: 0 in 0.342s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.info is being set with open permissions: ugo+rw Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.info Sep 01 02:23:36 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2" returned: 0 in 0.488s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2 Sep 01 02:23:36 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1" returned: 0 in 0.484s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1 Sep 01 02:23:36 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.info" returned: 0 in 0.345s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.646s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:36 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a3e7c86b-7ede-4cfa-9ef3-e69ac99cf7d5 tempest-VolumeDependencyTests-595576352 None] Create snapshot completed successfully Sep 01 02:23:36 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b4149b49-e2f6-4529-9d8e-eb3749b375b2" returned: 0 in 0.345s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b4149b49-e2f6-4529-9d8e-eb3749b375b2" released by "delete_volume" :: held 0.936s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Created reservations ['db7fca3b-1f8e-474f-ad2b-6a254ef5dc68', '362894c0-d771-4024-a777-9bdd7411e8c4', '6d4f052d-0c7b-48b9-b990-7cd077d60f0b', '53231d49-c26e-434c-9f09-0b94bfbd37bc'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:36 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b633c1d9-d379-4742-96e1-e71897b70bd1" returned: 0 in 0.317s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-quobyte-b633c1d9-d379-4742-96e1-e71897b70bd1" released by "delete_volume" :: held 0.915s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:36 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Created reservations ['49241351-40d1-40a9-b801-0fb0dcae41f3', '9cb2d541-2f7d-44ef-b4a6-78883c765f2c', '540250c2-a4c3-4320-943e-ecc1e9945726', 'c922547b-07cf-4a12-b7b8-374fcbdcd292'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:37 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:37 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:37 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d48608a4-f450-4098-a6da-a17982285fbf tempest-ProjectMemberTests-846567292 None] Lock "cinder-b4149b49-e2f6-4529-9d8e-eb3749b375b2-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:37 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.283s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Deleted volume successfully. Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-b7ce8bd0-3024-4c69-a7e0-1b1af1c2615d tempest-CreateVolumesFromSourceVolumeTest-759318428 None] Lock "cinder-b633c1d9-d379-4742-96e1-e71897b70bd1-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Flow 'volume_create_manager' (40d62fd2-eabb-4695-8a97-ddc96766cfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c977538-b893-42ac-b19b-e69454054bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c977538-b893-42ac-b19b-e69454054bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1410079347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da97e9c-44a5-4fae-afa7-1cd5558bbb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949d4e45edd6466089e2f3f7dcf58684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=37a37f27-01e7-4356-931e-c6395e921eb9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:38Z,use_quota=True,user_id='813f8a1a001a471e8b34c76f079e6a92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0beaf98-a39d-43ce-81bb-5b57d08bfc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0beaf98-a39d-43ce-81bb-5b57d08bfc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e38e100-1023-4b4d-bb2c-c89ffb58ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e38e100-1023-4b4d-bb2c-c89ffb58ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5da97e9c-44a5-4fae-afa7-1cd5558bbb7b', 'volume_name': 'volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b', 'volume_size': 1, 'snapshot_id': '37a37f27-01e7-4356-931e-c6395e921eb9'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af80b627-ba0b-44d5-847a-c1a465b7a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af80b627-ba0b-44d5-847a-c1a465b7a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84aaff6e-d920-4347-b52d-f94357ccdbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:37 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Volume 5da97e9c-44a5-4fae-afa7-1cd5558bbb7b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b', 'volume_size': 1, 'snapshot_id': '37a37f27-01e7-4356-931e-c6395e921eb9'} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-quobyte-37a37f27-01e7-4356-931e-c6395e921eb9-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-37a37f27-01e7-4356-931e-c6395e921eb9-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Creating volume 5da97e9c-44a5-4fae-afa7-1cd5558bbb7b from snapshot 37a37f27-01e7-4356-931e-c6395e921eb9 {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-quobyte-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] snapshot: 37a37f27-01e7-4356-931e-c6395e921eb9, volume: 5da97e9c-44a5-4fae-afa7-1cd5558bbb7b, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff9739c-8bbd-4d31-8d77-f831f95c85ac]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:38 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 Sep 01 02:23:38 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:38 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9" returned: 0 in 0.490s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (a14a9249-fb91-4db1-ada3-a72e8e83017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2b4d31-dd1f-426f-9798-f6aa76f6b7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d1e7d-8740-45de-a4a0-cf70e997fec1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd2b4d31-dd1f-426f-9798-f6aa76f6b7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765714964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d2814e-425f-4898-91b6-219d2c402ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:39Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ddeaae9-debc-49ff-b8b2-ce8dcb992502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ddeaae9-debc-49ff-b8b2-ce8dcb992502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1bd891-5935-43e6-80ef-6c991facbfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1bd891-5935-43e6-80ef-6c991facbfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d2814e-425f-4898-91b6-219d2c402ad8', 'volume_name': 'volume-c6d2814e-425f-4898-91b6-219d2c402ad8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386d6702-1ba2-4f86-8e5b-594d87394adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386d6702-1ba2-4f86-8e5b-594d87394adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8ad6a7-39e4-4064-b1ca-bc6b69eb8d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:38 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Volume c6d2814e-425f-4898-91b6-219d2c402ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d2814e-425f-4898-91b6-219d2c402ad8', 'volume_size': 1} Sep 01 02:23:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:38 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 Sep 01 02:23:38 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:39 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" returned: 0 in 0.500s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:23:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:23:39 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:23:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:39 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b Sep 01 02:23:39 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:39 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Flow 'volume_create_manager' (875794cd-0118-41c5-91b3-f6f2fdb504c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acad894d-20d3-45d2-ac9f-e9fc42640510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acad894d-20d3-45d2-ac9f-e9fc42640510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1587418676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc55e48-f9ec-483f-85f5-187a51cc8d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2648d90f147243b6b0e2330c8312c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:40Z,use_quota=True,user_id='7a74b2a9a8794af1bad8aa0fbec76d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166b6c3f-f07d-4143-96b3-a4af310dce28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (166b6c3f-f07d-4143-96b3-a4af310dce28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4514e519-3206-4227-90e0-0a34e795d706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4514e519-3206-4227-90e0-0a34e795d706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc55e48-f9ec-483f-85f5-187a51cc8d0d', 'volume_name': 'volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2100b5f-38fe-48f7-a4b4-69e1044d77b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2100b5f-38fe-48f7-a4b4-69e1044d77b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65d6ec-2548-43a4-9997-4be1eb631287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Volume 6dc55e48-f9ec-483f-85f5-187a51cc8d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d', 'volume_size': 1} Sep 01 02:23:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:44 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" returned: 0 in 5.028s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:23:44 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Converted 1024.00 MB image at 203.60 MB/s Sep 01 02:23:44 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b is being set with open permissions: ugo+rw Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:44 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b Sep 01 02:23:44 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:44 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" returned: 0 in 0.270s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" released by "_copy_volume_from_snapshot" :: held 6.461s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-37a37f27-01e7-4356-931e-c6395e921eb9-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" released by "_create_volume_from_snapshot" :: held 6.532s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.552s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.784s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1765714964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d2814e-425f-4898-91b6-219d2c402ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:39Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Creating volume c6d2814e-425f-4898-91b6-219d2c402ad8 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:44 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:44 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 1073741824 Sep 01 02:23:44 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84aaff6e-d920-4347-b52d-f94357ccdbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b', 'volume_size': 1, 'snapshot_id': '37a37f27-01e7-4356-931e-c6395e921eb9'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3f3c90-884a-417e-b528-9853dfcebfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:44 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Volume volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b (5da97e9c-44a5-4fae-afa7-1cd5558bbb7b): created successfully Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3f3c90-884a-417e-b528-9853dfcebfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Flow 'volume_create_manager' (40d62fd2-eabb-4695-8a97-ddc96766cfb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:44 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-35c54758-4cc4-47c6-8291-bf2f3293cd59 tempest-VolumeDependencyTests-595576352 None] Created volume successfully. Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Flow 'volume_create_manager' (32a7abb7-e976-470b-80a1-999c837dd0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dfeedf-5b8c-40e5-bce2-5d6739ef93a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dfeedf-5b8c-40e5-bce2-5d6739ef93a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712221979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6bc5ab-bbc9-4c52-9234-0daf7d731e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac24bebe2c074ed6ad9fcd962f491f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:45Z,use_quota=True,user_id='0124f2d75df04e3e91e73a2e4f7591b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2308d20-5c96-4904-abc6-258fc36fc7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2308d20-5c96-4904-abc6-258fc36fc7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b7a52b-404c-465f-8286-6051894bd69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b7a52b-404c-465f-8286-6051894bd69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6bc5ab-bbc9-4c52-9234-0daf7d731e36', 'volume_name': 'volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d13f4ce-ce1b-481a-a528-6ab19f928706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d13f4ce-ce1b-481a-a528-6ab19f928706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735294e0-1bca-4b8e-abed-bc050e1348b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:44 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Volume 4f6bc5ab-bbc9-4c52-9234-0daf7d731e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36', 'volume_size': 1} Sep 01 02:23:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:45 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 1073741824" returned: 0 in 0.488s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 Sep 01 02:23:45 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8" returned: 0 in 0.247s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.050s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1587418676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc55e48-f9ec-483f-85f5-187a51cc8d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2648d90f147243b6b0e2330c8312c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:40Z,use_quota=True,user_id='7a74b2a9a8794af1bad8aa0fbec76d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Creating volume 6dc55e48-f9ec-483f-85f5-187a51cc8d0d {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:45 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8ad6a7-39e4-4064-b1ca-bc6b69eb8d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d2814e-425f-4898-91b6-219d2c402ad8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907e7893-501d-441c-8389-28a093f2bd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:45 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d 1073741824 Sep 01 02:23:45 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Volume volume-c6d2814e-425f-4898-91b6-219d2c402ad8 (c6d2814e-425f-4898-91b6-219d2c402ad8): created successfully Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907e7893-501d-441c-8389-28a093f2bd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (a14a9249-fb91-4db1-ada3-a72e8e83017d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9de85129-045e-4620-8447-ff26c3405e7c tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-37a37f27-01e7-4356-931e-c6395e921eb9-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Lock "cinder-37a37f27-01e7-4356-931e-c6395e921eb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-quobyte-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-quobyte-37a37f27-01e7-4356-931e-c6395e921eb9" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-37a37f27-01e7-4356-931e-c6395e921eb9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Deleting offline snapshot 37a37f27-01e7-4356-931e-c6395e921eb9 of volume 6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] snapshot_file for this snap is: volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c75d73-4c4f-4c37-922a-97cc4fc1b6b5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d 1073741824" returned: 0 in 0.479s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 Sep 01 02:23:45 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d Sep 01 02:23:45 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:46 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9" returned: 0 in 0.370s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:46 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d" returned: 0 in 0.246s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.230s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712221979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6bc5ab-bbc9-4c52-9234-0daf7d731e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac24bebe2c074ed6ad9fcd962f491f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:45Z,use_quota=True,user_id='0124f2d75df04e3e91e73a2e4f7591b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Creating volume 4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:46 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51850c2-56b8-49d1-bda8-c05f91d4cff2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:46 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 1073741824 Sep 01 02:23:46 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65d6ec-2548-43a4-9997-4be1eb631287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0884b058-0002-4a30-9b60-1f0eaa501aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:46 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Volume volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d (6dc55e48-f9ec-483f-85f5-187a51cc8d0d): created successfully Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0884b058-0002-4a30-9b60-1f0eaa501aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Flow 'volume_create_manager' (875794cd-0118-41c5-91b3-f6f2fdb504c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9ddc9203-282f-498b-a461-8c26fb0c7a11 tempest-ProjectReaderTests-1639809850 None] Created volume successfully. Sep 01 02:23:46 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 Sep 01 02:23:46 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "cinder-6dc55e48-f9ec-483f-85f5-187a51cc8d0d-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-6dc55e48-f9ec-483f-85f5-187a51cc8d0d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:46 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 1073741824" returned: 0 in 0.606s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "cinder-quobyte-6dc55e48-f9ec-483f-85f5-187a51cc8d0d" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-quobyte-6dc55e48-f9ec-483f-85f5-187a51cc8d0d" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[79010b2e-83f4-4384-9ab0-46b0e91967d1]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:46 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 Sep 01 02:23:46 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:46 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" returned: 0 in 0.697s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:46 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 Sep 01 02:23:46 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:46 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d Sep 01 02:23:46 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36" returned: 0 in 0.278s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.525s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735294e0-1bca-4b8e-abed-bc050e1348b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548d0874-bb15-4959-9d20-63a573155f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Creating offline snapshot c01e625d-4ab7-4fac-aab8-b978a8563c5c of volume c6d2814e-425f-4898-91b6-219d2c402ad8 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef49fdc-90b2-4aa7-93bf-9c5a713ea6b2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:47 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Volume volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 (4f6bc5ab-bbc9-4c52-9234-0daf7d731e36): created successfully Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548d0874-bb15-4959-9d20-63a573155f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Flow 'volume_create_manager' (32a7abb7-e976-470b-80a1-999c837dd0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a61fb7c8-fd7b-40a3-8687-6b0c4b8e1966 tempest-ProjectReaderTests-1084128697 None] Created volume successfully. Sep 01 02:23:47 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d" returned: 0 in 0.413s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:47 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:47 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d Sep 01 02:23:47 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9 Sep 01 02:23:47 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 Sep 01 02:23:47 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6dc55e48-f9ec-483f-85f5-187a51cc8d0d" returned: 0 in 0.282s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-quobyte-6dc55e48-f9ec-483f-85f5-187a51cc8d0d" released by "delete_volume" :: held 0.761s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1.37a37f27-01e7-4356-931e-c6395e921eb9" returned: 0 in 0.293s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-37a37f27-01e7-4356-931e-c6395e921eb9" released by "_delete_snapshot" :: held 1.880s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8" returned: 0 in 0.439s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" released by "delete_snapshot" :: held 1.922s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:47 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c 1G Sep 01 02:23:47 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Created reservations ['fe5871fa-810c-4499-aa6d-9a489072db65', '62da97eb-0ce9-4c0f-92e6-322aee4e886f', '43f7fc63-6efc-4625-a497-9ed2c4a5f5f0', '12bfa4a5-b3ed-4aba-bfb9-c408a91e7d4a'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Created reservations ['ef8316e0-66e3-4150-afbd-4e71a9be51e6', '5ee9cf4c-f594-436b-8560-aba6e46364e3', 'ad32847c-2c77-41fd-af01-1b3572a06431', 'f3084a12-d8fc-4afb-9eea-1c7872f29e9a'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:47 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:47 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Delete snapshot completed successfully. Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f5e9233f-2dae-4bbb-b25d-5d0c81293fbb tempest-VolumeDependencyTests-595576352 None] Lock "cinder-37a37f27-01e7-4356-931e-c6395e921eb9-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Lock "cinder-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-quobyte-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" acquired by "delete_volume" :: waited 0.036s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2610b11-77d2-40f6-b1bb-861acf4efc02]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.396s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:48 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Deleted volume successfully. Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-49b3cdd1-ca22-435f-a491-10d75bd91301 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-6dc55e48-f9ec-483f-85f5-187a51cc8d0d-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:48 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:48 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c 1G" returned: 0 in 0.672s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:48 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d2814e-425f-4898-91b6-219d2c402ad8 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d2814e-425f-4898-91b6-219d2c402ad8 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c Sep 01 02:23:48 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "cinder-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Lock "cinder-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "cinder-quobyte-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Lock "cinder-quobyte-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b4674b-c816-486a-aa52-09f5d2ceeeda]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Flow 'volume_create_manager' (f54f4ac0-59f4-47f2-bbe9-c880899ebe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42f82d9-eabd-4813-917d-27a44152a651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d42f82d9-eabd-4813-917d-27a44152a651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084383163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e4bd2b-4055-4133-9618-d2fb056994bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2648d90f147243b6b0e2330c8312c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:48Z,use_quota=True,user_id='7a74b2a9a8794af1bad8aa0fbec76d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692d8931-e024-461c-abdd-7683275b67d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (692d8931-e024-461c-abdd-7683275b67d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 Sep 01 02:23:48 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4116dcab-48a0-4e66-8de1-9b8b32d6b9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4116dcab-48a0-4e66-8de1-9b8b32d6b9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89e4bd2b-4055-4133-9618-d2fb056994bc', 'volume_name': 'volume-89e4bd2b-4055-4133-9618-d2fb056994bc', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983b29de-a606-4318-82d7-37dda291874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983b29de-a606-4318-82d7-37dda291874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a4c32b-7b18-410f-b139-5745f7ce9eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Volume 89e4bd2b-4055-4133-9618-d2fb056994bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89e4bd2b-4055-4133-9618-d2fb056994bc', 'volume_size': 1} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:48 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d2814e-425f-4898-91b6-219d2c402ad8 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c" returned: 0 in 0.473s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:48 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c is being set with open permissions: ugo+rw Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c Sep 01 02:23:48 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:48 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" returned: 0 in 0.693s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1 Sep 01 02:23:48 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:48 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36 Sep 01 02:23:48 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" returned: 0 in 0.281s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c" returned: 0 in 0.351s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1" released by "delete_volume" :: held 1.079s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:49 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.info Sep 01 02:23:49 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Created reservations ['cfa8b743-35fe-430a-b786-dec0686bb85a', '49d7bb78-c12a-44bf-a50e-789186ee2727', 'dc0c4d56-868c-4447-a684-12a1e9f01bfb', 'f6e2cc54-0065-4023-b8de-ab4b80c95c1e'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:49 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36" returned: 0 in 0.328s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Lock "cinder-quobyte-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36" released by "delete_volume" :: held 0.786s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:49 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:49 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Created reservations ['28c4c278-eb6e-4fea-baa2-2ddb104fe050', '53de6a99-68e1-4e18-be69-ea80699e4673', '86ff9711-773d-4235-8315-1784a5453de2', 'f2ecab95-a21e-48e6-b705-49979bcafbba'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:49 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.info" returned: 0 in 0.324s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.info is being set with open permissions: ugo+rw Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:49 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:49 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.info Sep 01 02:23:49 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.370s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:49 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Deleted volume successfully. Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-067b159a-84b5-4da5-9717-bd23cea272ee tempest-VolumeDependencyTests-595576352 None] Lock "cinder-6c25a089-958c-4c6e-8b2c-aa6727a5dcc1-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:49 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.328s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:49 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Deleted volume successfully. Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.info" returned: 0 in 0.319s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084383163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89e4bd2b-4055-4133-9618-d2fb056994bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2648d90f147243b6b0e2330c8312c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:48Z,use_quota=True,user_id='7a74b2a9a8794af1bad8aa0fbec76d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Creating volume 89e4bd2b-4055-4133-9618-d2fb056994bc {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:49 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:49 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc 1073741824 Sep 01 02:23:49 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-1335930b-1bd0-4817-a025-27223ca179a4 tempest-ProjectReaderTests-1084128697 None] Lock "cinder-4f6bc5ab-bbc9-4c52-9234-0daf7d731e36-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:49 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-db06e124-a570-4cb4-96ae-5d5cc44e47fa tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Flow 'volume_create_manager' (8c60c84f-8ebd-49ed-a82c-c224091b0f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afb2805-aa1e-499a-adf6-3b4fb089ec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9afb2805-aa1e-499a-adf6-3b4fb089ec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109894723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942138d3-1bf4-45e8-916f-6aef5225bd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac24bebe2c074ed6ad9fcd962f491f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:50Z,use_quota=True,user_id='0124f2d75df04e3e91e73a2e4f7591b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f3bf81-3162-4a01-958d-28a58484583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f3bf81-3162-4a01-958d-28a58484583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08d7241-a12b-424a-b66f-c56f550ef350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08d7241-a12b-424a-b66f-c56f550ef350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942138d3-1bf4-45e8-916f-6aef5225bd16', 'volume_name': 'volume-942138d3-1bf4-45e8-916f-6aef5225bd16', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae11d89d-1b83-4b5f-acf4-6d7c968a7afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae11d89d-1b83-4b5f-acf4-6d7c968a7afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9015d7-471a-424d-b82d-df0e82a57056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Volume 942138d3-1bf4-45e8-916f-6aef5225bd16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942138d3-1bf4-45e8-916f-6aef5225bd16', 'volume_size': 1} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Lock "cinder-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:50 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc 1073741824" returned: 0 in 0.559s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Acquiring lock "cinder-quobyte-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa5be85-945e-40cc-8bd7-0231f2c2fb40]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc Sep 01 02:23:50 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b Sep 01 02:23:50 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc" returned: 0 in 0.251s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2109894723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942138d3-1bf4-45e8-916f-6aef5225bd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac24bebe2c074ed6ad9fcd962f491f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:50Z,use_quota=True,user_id='0124f2d75df04e3e91e73a2e4f7591b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Creating volume 942138d3-1bf4-45e8-916f-6aef5225bd16 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:50 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 1073741824 Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a4c32b-7b18-410f-b139-5745f7ce9eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89e4bd2b-4055-4133-9618-d2fb056994bc', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f46d81a-7787-4f89-b31e-e3ea7d2dd222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:50 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Volume volume-89e4bd2b-4055-4133-9618-d2fb056994bc (89e4bd2b-4055-4133-9618-d2fb056994bc): created successfully Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f46d81a-7787-4f89-b31e-e3ea7d2dd222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Flow 'volume_create_manager' (f54f4ac0-59f4-47f2-bbe9-c880899ebe78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:50 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-32fcefe7-9e7f-4136-8e82-611e21c6ec93 tempest-ProjectReaderTests-1639809850 None] Created volume successfully. Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-c01e625d-4ab7-4fac-aab8-b978a8563c5c-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Lock "cinder-c01e625d-4ab7-4fac-aab8-b978a8563c5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-c6d2814e-425f-4898-91b6-219d2c402ad8" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-c6d2814e-425f-4898-91b6-219d2c402ad8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-c01e625d-4ab7-4fac-aab8-b978a8563c5c" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-c01e625d-4ab7-4fac-aab8-b978a8563c5c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot c01e625d-4ab7-4fac-aab8-b978a8563c5c of volume c6d2814e-425f-4898-91b6-219d2c402ad8 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:50 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" returned: 0 in 0.456s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebbbaf2-4142-4958-8d4a-93ff246a3ef8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b Sep 01 02:23:50 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c Sep 01 02:23:50 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" returned: 0 in 0.293s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 1073741824" returned: 0 in 0.515s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Lock "cinder-quobyte-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b" released by "delete_volume" :: held 0.808s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 Sep 01 02:23:51 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Created reservations ['71dea360-80c1-4fc4-a427-e95473f4bce1', 'd04cdc36-4a7d-4793-9f32-7b2d2ce5a604', '6e6d3231-e8bc-4d1b-a200-b7eab401791d', '89fea729-2cf3-4f41-b02d-9a3ead376440'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:51 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c" returned: 0 in 0.469s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6d2814e-425f-4898-91b6-219d2c402ad8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec88a9-b93a-48df-9be6-d6676f87745a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:51 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 Sep 01 02:23:51 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16" returned: 0 in 0.297s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9015d7-471a-424d-b82d-df0e82a57056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942138d3-1bf4-45e8-916f-6aef5225bd16', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e9efc6-5c0e-4f99-9782-e70e4f8e7cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:51 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Volume volume-942138d3-1bf4-45e8-916f-6aef5225bd16 (942138d3-1bf4-45e8-916f-6aef5225bd16): created successfully Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e9efc6-5c0e-4f99-9782-e70e4f8e7cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Flow 'volume_create_manager' (8c60c84f-8ebd-49ed-a82c-c224091b0f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:51 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5b837e29-bfd0-4c01-aa47-8e79a9d36135 tempest-ProjectReaderTests-1084128697 None] Created volume successfully. Sep 01 02:23:51 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.311s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:51 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Deleted volume successfully. Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "cinder-89e4bd2b-4055-4133-9618-d2fb056994bc-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-89e4bd2b-4055-4133-9618-d2fb056994bc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-377d008d-ac6b-4ecb-92fb-b036d2ea307f tempest-VolumeDependencyTests-595576352 None] Lock "cinder-5da97e9c-44a5-4fae-afa7-1cd5558bbb7b-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "cinder-quobyte-89e4bd2b-4055-4133-9618-d2fb056994bc" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-quobyte-89e4bd2b-4055-4133-9618-d2fb056994bc" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:51 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8" returned: 0 in 0.422s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3631c96a-b055-4a55-84bf-97554400cfd7]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c Sep 01 02:23:51 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc Sep 01 02:23:51 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c" returned: 0 in 0.338s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c Sep 01 02:23:52 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc" returned: 0 in 0.398s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc Sep 01 02:23:52 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "cinder-942138d3-1bf4-45e8-916f-6aef5225bd16-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Lock "cinder-942138d3-1bf4-45e8-916f-6aef5225bd16-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "cinder-quobyte-942138d3-1bf4-45e8-916f-6aef5225bd16" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Lock "cinder-quobyte-942138d3-1bf4-45e8-916f-6aef5225bd16" acquired by "delete_volume" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:52 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8.c01e625d-4ab7-4fac-aab8-b978a8563c5c" returned: 0 in 0.289s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778569c-ed85-493d-ac50-0ecc029d7763]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-c01e625d-4ab7-4fac-aab8-b978a8563c5c" released by "_delete_snapshot" :: held 1.672s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-c6d2814e-425f-4898-91b6-219d2c402ad8" released by "delete_snapshot" :: held 1.704s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=290,cinder:SELECT=229,cinder:INSERT=76,cinder:DELETE=28 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:23:52 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-89e4bd2b-4055-4133-9618-d2fb056994bc" returned: 0 in 0.339s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-quobyte-89e4bd2b-4055-4133-9618-d2fb056994bc" released by "delete_volume" :: held 0.796s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Created reservations ['556c1767-4abd-4c15-bde3-54327800075d', 'b12c1134-193a-4137-bdd3-581751f533e9', '84a28352-9237-4f15-b981-575bae031d2c', 'd8a77757-4792-4471-8bd1-d411e77853e4'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:52 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 Sep 01 02:23:52 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Created reservations ['f2773bbd-f25d-4c0a-a3cb-45dc503c8b4f', '7f86fb1b-d78f-4c83-a1b1-fb81a81fe335', '074297fe-589b-497a-9055-81eb32ff1fc9', 'ab2c42cd-4ca5-4bf0-a104-fb18bf439fcd'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:52 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d0c5356e-6ccf-465f-a63e-7130508e8649 tempest-ProjectMemberTests-846567292 None] Lock "cinder-c01e625d-4ab7-4fac-aab8-b978a8563c5c-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:52 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16" returned: 0 in 0.511s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:53 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16 Sep 01 02:23:53 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-c6d2814e-425f-4898-91b6-219d2c402ad8-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-c6d2814e-425f-4898-91b6-219d2c402ad8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=225,cinder:UPDATE=324,cinder:INSERT=83,cinder:DELETE=27 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-c6d2814e-425f-4898-91b6-219d2c402ad8" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-c6d2814e-425f-4898-91b6-219d2c402ad8" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.456s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[72def444-162d-4e5e-a331-e35f767f957d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:53 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Deleted volume successfully. Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4105587f-a1e0-44ed-b810-d504699289a6 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-89e4bd2b-4055-4133-9618-d2fb056994bc-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:53 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-942138d3-1bf4-45e8-916f-6aef5225bd16" returned: 0 in 0.344s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Lock "cinder-quobyte-942138d3-1bf4-45e8-916f-6aef5225bd16" released by "delete_volume" :: held 0.932s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Created reservations ['b5aab275-8ad5-43a8-bd70-db074579557f', 'd84edfe0-290d-46b8-ab11-56b9a4397d2e', '3e5d3a73-988e-4f97-a8cb-e87c26510d8c', '20c2baf9-7c21-49e1-aa2c-720431b868e0'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:53 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 Sep 01 02:23:53 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:53 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:53 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:53 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8" returned: 0 in 0.649s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:53 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:53 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8 Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.397s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:53 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:53 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Deleted volume successfully. Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-e2234d3f-a00d-49a9-91ba-169bdd1a4c64 tempest-ProjectReaderTests-1084128697 None] Lock "cinder-942138d3-1bf4-45e8-916f-6aef5225bd16-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Flow 'volume_create_manager' (6fee9873-1442-42a3-a8f6-38480a7c2e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94dcc23-566e-47b1-a26d-1f45cf5f0f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d94dcc23-566e-47b1-a26d-1f45cf5f0f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853728040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4277a62-cbfa-414d-94f0-bd2094390a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2648d90f147243b6b0e2330c8312c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:54Z,use_quota=True,user_id='7a74b2a9a8794af1bad8aa0fbec76d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45271ec4-69ea-437e-93c8-1f34c4334842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45271ec4-69ea-437e-93c8-1f34c4334842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f5e5b1-a6bb-4aac-a788-73b936dce6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f5e5b1-a6bb-4aac-a788-73b936dce6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4277a62-cbfa-414d-94f0-bd2094390a45', 'volume_name': 'volume-a4277a62-cbfa-414d-94f0-bd2094390a45', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6feeafb6-2958-4f51-8dc6-ff20bba1fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6feeafb6-2958-4f51-8dc6-ff20bba1fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c65b2da-ebba-4a81-a09b-a61b3509f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:54 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Volume a4277a62-cbfa-414d-94f0-bd2094390a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4277a62-cbfa-414d-94f0-bd2094390a45', 'volume_size': 1} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-853728040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4277a62-cbfa-414d-94f0-bd2094390a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2648d90f147243b6b0e2330c8312c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:54Z,use_quota=True,user_id='7a74b2a9a8794af1bad8aa0fbec76d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Creating volume a4277a62-cbfa-414d-94f0-bd2094390a45 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:54 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 1073741824 Sep 01 02:23:54 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-c6d2814e-425f-4898-91b6-219d2c402ad8" returned: 0 in 0.294s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-c6d2814e-425f-4898-91b6-219d2c402ad8" released by "delete_volume" :: held 1.020s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Created reservations ['dac8500d-5f82-4a0b-931b-e4de9cc8122c', 'c35057b4-9b48-4969-be1f-07afd3675d84', '12ff4084-e4a8-4358-8eb0-3250e7c04204', 'bfec126a-7a87-453e-9c6a-46b63e48d6c8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:54 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.319s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:54 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 1073741824" returned: 0 in 0.581s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7dab5a6c-56c7-49ed-8483-7d21f7505ac6 tempest-ProjectMemberTests-846567292 None] Lock "cinder-c6d2814e-425f-4898-91b6-219d2c402ad8-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 Sep 01 02:23:54 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:55 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45" returned: 0 in 0.305s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c65b2da-ebba-4a81-a09b-a61b3509f266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4277a62-cbfa-414d-94f0-bd2094390a45', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781e0ea2-6153-4e92-a766-52dd7871fcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Volume volume-a4277a62-cbfa-414d-94f0-bd2094390a45 (a4277a62-cbfa-414d-94f0-bd2094390a45): created successfully Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781e0ea2-6153-4e92-a766-52dd7871fcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Flow 'volume_create_manager' (6fee9873-1442-42a3-a8f6-38480a7c2e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8ff33ec4-76a4-4adc-8b11-b2c7c8ebf547 tempest-ProjectReaderTests-1639809850 None] Created volume successfully. Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (2cae6c4f-8f47-41a8-a9e8-e40b103ddc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9769f20-1393-4da1-82ad-38117bc0ed5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9769f20-1393-4da1-82ad-38117bc0ed5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-127301341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181ecc9f-697e-4de5-b6b2-0553e674562e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:56Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262df0c1-92b6-45d1-99d4-f9df15c761ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262df0c1-92b6-45d1-99d4-f9df15c761ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03248211-461b-4472-8789-f194384debe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03248211-461b-4472-8789-f194384debe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '181ecc9f-697e-4de5-b6b2-0553e674562e', 'volume_name': 'volume-181ecc9f-697e-4de5-b6b2-0553e674562e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba68c9f-ed31-4794-a89e-9db3db6950bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba68c9f-ed31-4794-a89e-9db3db6950bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4eac83e-1f59-4351-9075-c911d21f2a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Volume 181ecc9f-697e-4de5-b6b2-0553e674562e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-181ecc9f-697e-4de5-b6b2-0553e674562e', 'volume_size': 1} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-127301341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=181ecc9f-697e-4de5-b6b2-0553e674562e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:56Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Creating volume 181ecc9f-697e-4de5-b6b2-0553e674562e {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:55 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e 1073741824 Sep 01 02:23:56 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "cinder-a4277a62-cbfa-414d-94f0-bd2094390a45-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-a4277a62-cbfa-414d-94f0-bd2094390a45-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "cinder-quobyte-a4277a62-cbfa-414d-94f0-bd2094390a45" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-quobyte-a4277a62-cbfa-414d-94f0-bd2094390a45" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[967f3d7b-56aa-4cfa-8c66-ef71bbf6c4f8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 Sep 01 02:23:56 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e 1073741824" returned: 0 in 0.631s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e Sep 01 02:23:56 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Flow 'volume_create_manager' (f662b6d2-1471-4be7-aefc-f824cce17a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f341e70a-072b-49cd-bca0-32a8b9e7f659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f341e70a-072b-49cd-bca0-32a8b9e7f659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5476e6a7-1b86-4ded-8552-f1f819392d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cb8d2a9d5841de8ab358cee9576844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:57Z,use_quota=True,user_id='6b564cf179644b939c0072d89055d5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:56 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3d1a7b-3b55-4d69-967b-0427087551f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3d1a7b-3b55-4d69-967b-0427087551f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea4009e-53b6-46ed-b3b1-d0593849dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea4009e-53b6-46ed-b3b1-d0593849dae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5476e6a7-1b86-4ded-8552-f1f819392d49', 'volume_name': 'volume-5476e6a7-1b86-4ded-8552-f1f819392d49', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696653da-1bf6-4ee1-aec5-7e559a865c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (696653da-1bf6-4ee1-aec5-7e559a865c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a5ca89-e34b-431b-98ed-65a075d9594c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:56 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Volume 5476e6a7-1b86-4ded-8552-f1f819392d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5476e6a7-1b86-4ded-8552-f1f819392d49', 'volume_size': 1} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45" returned: 0 in 0.632s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45 Sep 01 02:23:56 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e" returned: 0 in 0.397s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5476e6a7-1b86-4ded-8552-f1f819392d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cb8d2a9d5841de8ab358cee9576844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:57Z,use_quota=True,user_id='6b564cf179644b939c0072d89055d5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Creating volume 5476e6a7-1b86-4ded-8552-f1f819392d49 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:57 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4eac83e-1f59-4351-9075-c911d21f2a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-181ecc9f-697e-4de5-b6b2-0553e674562e', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfac965-eb96-47ee-9502-6514b9027be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:57 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 1073741824 Sep 01 02:23:57 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Volume volume-181ecc9f-697e-4de5-b6b2-0553e674562e (181ecc9f-697e-4de5-b6b2-0553e674562e): created successfully Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfac965-eb96-47ee-9502-6514b9027be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (2cae6c4f-8f47-41a8-a9e8-e40b103ddc38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fe61fb28-2f7a-4de9-9bd4-7cc2312444e6 tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:23:57 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-a4277a62-cbfa-414d-94f0-bd2094390a45" returned: 0 in 0.300s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-quobyte-a4277a62-cbfa-414d-94f0-bd2094390a45" released by "delete_volume" :: held 0.985s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Created reservations ['40d10599-02a7-48e3-8f7b-bfd03f7161d3', '8ebfc455-3a7c-43cf-adf8-d7e79dcda822', '9c63f7f3-2837-43f2-b5b5-75d8c35fd590', '6176e5fc-5f42-475e-be4e-76d3ba82db2b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:23:57 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 1073741824" returned: 0 in 0.507s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 Sep 01 02:23:57 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.289s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Deleted volume successfully. Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f1b61ef5-d915-4972-b210-689b413335c3 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-a4277a62-cbfa-414d-94f0-bd2094390a45-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:57 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49" returned: 0 in 0.249s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a5ca89-e34b-431b-98ed-65a075d9594c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5476e6a7-1b86-4ded-8552-f1f819392d49', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba38458b-5f8a-44a1-b256-df18b9918271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:57 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Volume volume-5476e6a7-1b86-4ded-8552-f1f819392d49 (5476e6a7-1b86-4ded-8552-f1f819392d49): created successfully Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba38458b-5f8a-44a1-b256-df18b9918271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:57 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Flow 'volume_create_manager' (f662b6d2-1471-4be7-aefc-f824cce17a65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:57 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f0142203-6cb6-4a2c-aa56-e03c5baf7b66 tempest-CinderUnicodeTest-1121366589 None] Created volume successfully. Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Creating offline snapshot d25a1822-700d-4898-8d43-72f590610c1f of volume 181ecc9f-697e-4de5-b6b2-0553e674562e {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39a9537-e13d-4326-85cb-97e179bd6d6e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:58 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e Sep 01 02:23:58 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:58 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e" returned: 0 in 0.370s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:58 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f 1G Sep 01 02:23:58 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Flow 'volume_create_manager' (b11e79d0-810e-4264-adff-10f518f1ab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a850876-ad64-449c-85e9-617bb1ad8062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a850876-ad64-449c-85e9-617bb1ad8062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424371257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dd6203-6926-4152-b26e-a35e48e87bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2648d90f147243b6b0e2330c8312c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:59Z,use_quota=True,user_id='7a74b2a9a8794af1bad8aa0fbec76d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af827425-6703-4d82-86fc-c359ec76689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af827425-6703-4d82-86fc-c359ec76689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6a15c8-c819-41a4-8e48-24c91ade6fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6a15c8-c819-41a4-8e48-24c91ade6fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8dd6203-6926-4152-b26e-a35e48e87bb8', 'volume_name': 'volume-d8dd6203-6926-4152-b26e-a35e48e87bb8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82a88c6-bac8-4465-a379-a995023b1bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f82a88c6-bac8-4465-a379-a995023b1bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a677d754-c936-4937-a46d-16d10236b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Volume d8dd6203-6926-4152-b26e-a35e48e87bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8dd6203-6926-4152-b26e-a35e48e87bb8', 'volume_size': 1} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f 1G" returned: 0 in 0.530s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-181ecc9f-697e-4de5-b6b2-0553e674562e -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-181ecc9f-697e-4de5-b6b2-0553e674562e -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f Sep 01 02:23:59 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:59 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-181ecc9f-697e-4de5-b6b2-0553e674562e -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:59 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f is being set with open permissions: ugo+rw Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f Sep 01 02:23:59 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Flow 'volume_create_manager' (f79e9367-5576-4438-9083-73615e0c54bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb6727f-e26e-42f4-a32e-7a141774b65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb6727f-e26e-42f4-a32e-7a141774b65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1774817719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b40408-d044-407b-8483-907474f25bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cb8d2a9d5841de8ab358cee9576844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:59Z,use_quota=True,user_id='6b564cf179644b939c0072d89055d5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b893a1e-0cf1-41f0-853a-f49785355467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b893a1e-0cf1-41f0-853a-f49785355467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65476a9f-9d80-4c9d-8bba-2f98007d63f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65476a9f-9d80-4c9d-8bba-2f98007d63f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b40408-d044-407b-8483-907474f25bfc', 'volume_name': 'volume-f4b40408-d044-407b-8483-907474f25bfc', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63879585-3cec-4b9a-842c-b6e159536e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63879585-3cec-4b9a-842c-b6e159536e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01d9914-a3b8-4a06-bf81-e7f7a05e9366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:59 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Volume f4b40408-d044-407b-8483-907474f25bfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b40408-d044-407b-8483-907474f25bfc', 'volume_size': 1} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:59 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f" returned: 0 in 0.242s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.info Sep 01 02:23:59 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:59 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.info" returned: 0 in 0.276s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:59 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.info is being set with open permissions: ugo+rw Sep 01 02:23:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.info Sep 01 02:23:59 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:00 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.info" returned: 0 in 0.257s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.116s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-424371257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8dd6203-6926-4152-b26e-a35e48e87bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2648d90f147243b6b0e2330c8312c1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:59Z,use_quota=True,user_id='7a74b2a9a8794af1bad8aa0fbec76d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Creating volume d8dd6203-6926-4152-b26e-a35e48e87bb8 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:00 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:00 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 1073741824 Sep 01 02:24:00 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0d985c8a-7520-4eb7-9cc0-1342ffc74b49 tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:24:00 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 1073741824" returned: 0 in 0.415s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:00 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 Sep 01 02:24:00 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:00 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8" returned: 0 in 0.272s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1774817719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b40408-d044-407b-8483-907474f25bfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cb8d2a9d5841de8ab358cee9576844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:59Z,use_quota=True,user_id='6b564cf179644b939c0072d89055d5ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Creating volume f4b40408-d044-407b-8483-907474f25bfc {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:00 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a677d754-c936-4937-a46d-16d10236b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8dd6203-6926-4152-b26e-a35e48e87bb8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:00 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc 1073741824 Sep 01 02:24:00 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d49bad-eb17-4136-80cf-1671b91e82b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:00 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Volume volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 (d8dd6203-6926-4152-b26e-a35e48e87bb8): created successfully Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d49bad-eb17-4136-80cf-1671b91e82b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:00 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Flow 'volume_create_manager' (b11e79d0-810e-4264-adff-10f518f1ab89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:00 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a116a127-840d-42ca-8789-b0bafa203c92 tempest-ProjectReaderTests-1639809850 None] Created volume successfully. Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-d25a1822-700d-4898-8d43-72f590610c1f-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-d25a1822-700d-4898-8d43-72f590610c1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-181ecc9f-697e-4de5-b6b2-0553e674562e" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-181ecc9f-697e-4de5-b6b2-0553e674562e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-d25a1822-700d-4898-8d43-72f590610c1f" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-d25a1822-700d-4898-8d43-72f590610c1f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot d25a1822-700d-4898-8d43-72f590610c1f of volume 181ecc9f-697e-4de5-b6b2-0553e674562e {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98f704b-3750-457f-8f67-bad687389b56]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:01 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc 1073741824" returned: 0 in 0.501s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:01 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc Sep 01 02:24:01 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:01 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f Sep 01 02:24:01 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:01 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc" returned: 0 in 0.267s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d01d9914-a3b8-4a06-bf81-e7f7a05e9366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b40408-d044-407b-8483-907474f25bfc', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feffbb5c-6881-4bb5-a67c-1fed5b3c75d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:01 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Volume volume-f4b40408-d044-407b-8483-907474f25bfc (f4b40408-d044-407b-8483-907474f25bfc): created successfully Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feffbb5c-6881-4bb5-a67c-1fed5b3c75d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Flow 'volume_create_manager' (f79e9367-5576-4438-9083-73615e0c54bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:01 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-cc242c5a-59c1-416e-8968-f312aaaa9097 tempest-CinderUnicodeTest-1121366589 None] Created volume successfully. Sep 01 02:24:01 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f" returned: 0 in 0.409s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-181ecc9f-697e-4de5-b6b2-0553e674562e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5791534-d0cc-4f3d-b5ba-255b001b9683]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:01 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e Sep 01 02:24:01 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "cinder-d8dd6203-6926-4152-b26e-a35e48e87bb8-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-d8dd6203-6926-4152-b26e-a35e48e87bb8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "cinder-quobyte-d8dd6203-6926-4152-b26e-a35e48e87bb8" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-quobyte-d8dd6203-6926-4152-b26e-a35e48e87bb8" acquired by "delete_volume" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85bb6ce-28e3-463a-8c22-1365043b3a0f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:02 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e" returned: 0 in 0.399s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:02 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f Sep 01 02:24:02 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:02 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 Sep 01 02:24:02 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:02 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8" returned: 0 in 0.403s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:02 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f" returned: 0 in 0.402s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:02 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8 Sep 01 02:24:02 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:02 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f Sep 01 02:24:02 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Creating offline snapshot 26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 of volume f4b40408-d044-407b-8483-907474f25bfc {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[913479e9-97c8-4b5b-aa1e-acac0e6fc6d4]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:02 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-d8dd6203-6926-4152-b26e-a35e48e87bb8" returned: 0 in 0.283s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-quobyte-d8dd6203-6926-4152-b26e-a35e48e87bb8" released by "delete_volume" :: held 0.736s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:02 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e.d25a1822-700d-4898-8d43-72f590610c1f" returned: 0 in 0.307s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-d25a1822-700d-4898-8d43-72f590610c1f" released by "_delete_snapshot" :: held 1.621s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:02 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc Sep 01 02:24:02 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-181ecc9f-697e-4de5-b6b2-0553e674562e" released by "delete_snapshot" :: held 1.653s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:02 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Created reservations ['0fd37dda-b42d-4be7-ad3a-a3c80f9256e1', 'b827624d-d589-4779-a0e5-62eb6d35f2be', '874b42aa-9a8e-4392-9bb4-c56dee938a2d', '257fcba1-eba8-4fc7-af71-3145e0f3c51b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Created reservations ['bfba6680-46f9-4674-8c7c-3d4919ed9674', '0f3ae40f-853c-4ef5-8ae6-46228882a744', 'dc18ab8d-6297-4cde-9cd9-e75e4de55b6b', '9ea2185a-cb71-48b4-bead-a27d4cfcd220'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:03 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:03 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:03 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-debe3357-c934-4c75-9359-de056db89fb9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-d25a1822-700d-4898-8d43-72f590610c1f-delete_snapshot" released by "delete_snapshot" :: held 1.853s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:03 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc" returned: 0 in 0.416s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:03 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 1G Sep 01 02:24:03 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:03 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.279s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:03 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Deleted volume successfully. Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-19b8f06f-e009-4679-a34e-ae46165ccbe3 tempest-ProjectReaderTests-1639809850 None] Lock "cinder-d8dd6203-6926-4152-b26e-a35e48e87bb8-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-181ecc9f-697e-4de5-b6b2-0553e674562e-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Lock "cinder-181ecc9f-697e-4de5-b6b2-0553e674562e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-181ecc9f-697e-4de5-b6b2-0553e674562e" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-181ecc9f-697e-4de5-b6b2-0553e674562e" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b52932d-7e16-4ec6-9f10-44871f4a9d64]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:03 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e Sep 01 02:24:03 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:03 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 1G" returned: 0 in 0.501s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:03 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b40408-d044-407b-8483-907474f25bfc -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:03 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b40408-d044-407b-8483-907474f25bfc -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 Sep 01 02:24:03 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:04 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e" returned: 0 in 0.424s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:04 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e Sep 01 02:24:04 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:04 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4b40408-d044-407b-8483-907474f25bfc -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0" returned: 0 in 0.341s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:04 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 is being set with open permissions: ugo+rw Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:04 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 Sep 01 02:24:04 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:04 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-181ecc9f-697e-4de5-b6b2-0553e674562e" returned: 0 in 0.277s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-181ecc9f-697e-4de5-b6b2-0553e674562e" released by "delete_volume" :: held 0.779s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:04 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0" returned: 0 in 0.281s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Created reservations ['d8d7a465-87e8-403a-85fb-516add6b7781', '3afe5a56-111c-458d-a8b9-db9b392d89a7', 'ffe2afce-f770-48bb-a408-03e6ddf1c289', 'd6fed0e1-8fe0-4239-a160-2aa79f3bd31f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:04 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.info Sep 01 02:24:04 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:04 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:04 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:04 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.info" returned: 0 in 0.322s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:04 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.info is being set with open permissions: ugo+rw Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:04 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.info Sep 01 02:24:04 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:04 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.338s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:04 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:24:04 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9e012d10-aac5-4e88-af13-c6eb8b611a8d tempest-ProjectMemberTests-846567292 None] Lock "cinder-181ecc9f-697e-4de5-b6b2-0553e674562e-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:05 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.info" returned: 0 in 0.404s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:05 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c3d86a4a-807e-4db6-860b-ef9e6dc5e0f0 tempest-CinderUnicodeTest-1121366589 None] Create snapshot completed successfully Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (9eeaf8b4-c72d-45ff-8ec4-ae27af917434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6528e7f3-1005-4db0-91c5-bf8ada920ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6528e7f3-1005-4db0-91c5-bf8ada920ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1146297131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727dd64a-71eb-466b-bfcb-b65fcdfc4f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:05Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213ca5f0-db14-4ca0-b9d8-878d008e07fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213ca5f0-db14-4ca0-b9d8-878d008e07fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeded991-a066-464f-81e1-14cb951c07bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeded991-a066-464f-81e1-14cb951c07bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727dd64a-71eb-466b-bfcb-b65fcdfc4f1c', 'volume_name': 'volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4155f24d-8214-4094-9ac9-896014201e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4155f24d-8214-4094-9ac9-896014201e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd4fa6b-7f31-4ec5-baf5-dcf7c9ddaf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:05 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Volume 727dd64a-71eb-466b-bfcb-b65fcdfc4f1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c', 'volume_size': 1} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1146297131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727dd64a-71eb-466b-bfcb-b65fcdfc4f1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:05Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Creating volume 727dd64a-71eb-466b-bfcb-b65fcdfc4f1c {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:05 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:05 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c 1073741824 Sep 01 02:24:05 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:05 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c 1073741824" returned: 0 in 0.417s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:05 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c Sep 01 02:24:05 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "cinder-26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:05 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "cinder-quobyte-f4b40408-d044-407b-8483-907474f25bfc" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-quobyte-f4b40408-d044-407b-8483-907474f25bfc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "cinder-quobyte-26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-quobyte-26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Deleting offline snapshot 26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 of volume f4b40408-d044-407b-8483-907474f25bfc {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:06 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] snapshot_file for this snap is: volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" returned: 0 in 0.291s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9ccdd6-23b0-4d9c-a7bf-e5858a00a16c]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd4fa6b-7f31-4ec5-baf5-dcf7c9ddaf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b639fc-91ed-498b-816a-af3bf105b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:06 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Volume volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c (727dd64a-71eb-466b-bfcb-b65fcdfc4f1c): created successfully Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b639fc-91ed-498b-816a-af3bf105b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (9eeaf8b4-c72d-45ff-8ec4-ae27af917434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:06 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-94ff6a9d-37df-4308-a0a1-3b75dcb9b94a tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:24:06 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 Sep 01 02:24:06 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:06 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:06 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:06 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0" returned: 0 in 0.369s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4b40408-d044-407b-8483-907474f25bfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0675bbd-e526-42b5-aa72-e243904227a5]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:06 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc Sep 01 02:24:06 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:06 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.267s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:24:06 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc" returned: 0 in 0.345s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:06 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 Sep 01 02:24:06 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:07 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0" returned: 0 in 0.329s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:07 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0 Sep 01 02:24:07 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:07 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc.26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0" returned: 0 in 0.257s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-quobyte-26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0" released by "_delete_snapshot" :: held 1.431s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-quobyte-f4b40408-d044-407b-8483-907474f25bfc" released by "delete_snapshot" :: held 1.461s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Creating offline snapshot ae05e89b-6101-4429-9cb8-5263dcca2f7a of volume 727dd64a-71eb-466b-bfcb-b65fcdfc4f1c {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb21426-e732-49db-ac39-27c5ccc0718e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Created reservations ['8ffa2b4d-3552-438b-b58f-290717c7acd3', '3ae59451-b411-4de2-af2f-b1eec822e1c8', '2db02312-15cd-425e-8ba1-df3f31c07d40', 'f0968460-cddf-446e-b990-e490999f21c7'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:07 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c Sep 01 02:24:07 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:07 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Delete snapshot completed successfully. Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-73df27ff-59b2-4d08-8280-061b6b3ed2a1 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-26e9bfb0-3cf8-4d80-84cb-a467a24b8ca0-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:07 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" returned: 0 in 0.375s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:07 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:07 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a 1G Sep 01 02:24:07 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "cinder-f4b40408-d044-407b-8483-907474f25bfc-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-f4b40408-d044-407b-8483-907474f25bfc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "cinder-quobyte-f4b40408-d044-407b-8483-907474f25bfc" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-quobyte-f4b40408-d044-407b-8483-907474f25bfc" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ca2f7-2119-4604-9a80-7a87631cc2b6]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:08 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a 1G" returned: 0 in 0.443s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:08 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc Sep 01 02:24:08 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:08 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a Sep 01 02:24:08 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:08 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc" returned: 0 in 0.386s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:08 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a" returned: 0 in 0.303s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:08 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a is being set with open permissions: ugo+rw Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:08 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc Sep 01 02:24:08 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:08 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a Sep 01 02:24:08 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:08 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f4b40408-d044-407b-8483-907474f25bfc" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:08 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a" returned: 0 in 0.253s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-quobyte-f4b40408-d044-407b-8483-907474f25bfc" released by "delete_volume" :: held 0.698s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:08 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.info Sep 01 02:24:08 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:08 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Created reservations ['8ead9aff-0120-4ebd-992e-617fefe44572', '672719a9-690f-4b4a-8118-c2f91c483235', '1ee4f028-a93e-4fc7-89e3-03d0e49137a3', 'f91c177d-ee7f-4df8-b8ba-e4cc2db44370'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:09 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:09 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:09 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.info" returned: 0 in 0.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:09 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.info is being set with open permissions: ugo+rw Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:09 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.info Sep 01 02:24:09 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "cinder-5476e6a7-1b86-4ded-8552-f1f819392d49-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:09 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.276s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-5476e6a7-1b86-4ded-8552-f1f819392d49-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Deleted volume successfully. Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fd733092-3492-4088-8449-cfa094e64bb8 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-f4b40408-d044-407b-8483-907474f25bfc-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "cinder-quobyte-5476e6a7-1b86-4ded-8552-f1f819392d49" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-quobyte-5476e6a7-1b86-4ded-8552-f1f819392d49" acquired by "delete_volume" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce966fef-edb9-48a4-8090-b0bebbc2e105]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:09 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.info" returned: 0 in 0.273s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:09 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c68734dd-9b3a-4d4a-bc7a-82f3e309d318 tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:24:09 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 Sep 01 02:24:09 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:09 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49" returned: 0 in 0.365s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:09 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:09 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49 Sep 01 02:24:09 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:10 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-5476e6a7-1b86-4ded-8552-f1f819392d49" returned: 0 in 0.259s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-quobyte-5476e6a7-1b86-4ded-8552-f1f819392d49" released by "delete_volume" :: held 0.669s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Created reservations ['8c237d48-4f3e-4a0b-a5c8-54f8e7e2eed7', 'ab7c4d23-1343-4444-80c3-3052dc9b4a0c', 'e5c4aeb7-f185-402f-beba-664e99c20863', '531754f1-50cb-4abc-9df1-55fb17df7d49'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:10 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:10 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:10 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.265s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:10 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Deleted volume successfully. Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-d6a11027-7ce1-4bd4-8b26-514e00902225 tempest-CinderUnicodeTest-1121366589 None] Lock "cinder-5476e6a7-1b86-4ded-8552-f1f819392d49-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-ae05e89b-6101-4429-9cb8-5263dcca2f7a-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Lock "cinder-ae05e89b-6101-4429-9cb8-5263dcca2f7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-ae05e89b-6101-4429-9cb8-5263dcca2f7a" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-ae05e89b-6101-4429-9cb8-5263dcca2f7a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot ae05e89b-6101-4429-9cb8-5263dcca2f7a of volume 727dd64a-71eb-466b-bfcb-b65fcdfc4f1c {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[043652d5-6607-46cb-a9ed-fe1ddb3289de]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:10 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:10 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a Sep 01 02:24:10 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:11 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a" returned: 0 in 0.369s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:11 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:11 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e598ad4-8cfc-42c6-94d4-e40b2f4498f0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:11 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c Sep 01 02:24:11 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:11 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" returned: 0 in 0.393s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:11 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a Sep 01 02:24:11 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:11 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a" returned: 0 in 0.346s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:11 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:11 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a Sep 01 02:24:11 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:12 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c.ae05e89b-6101-4429-9cb8-5263dcca2f7a" returned: 0 in 0.261s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-ae05e89b-6101-4429-9cb8-5263dcca2f7a" released by "_delete_snapshot" :: held 1.473s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" released by "delete_snapshot" :: held 1.501s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Created reservations ['47c99351-59c7-4c2c-b42c-7fa4d8c0fd15', '6566e782-3937-417e-aa24-f589339cc2f2', 'a83bd17e-7a0f-4db5-8d6c-27f14d7a780e', 'f0f1e6bb-471d-457f-af2f-397cbbc62d89'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:12 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-95384af7-c64a-4669-88a5-285366f8f1fe tempest-ProjectMemberTests-846567292 None] Lock "cinder-ae05e89b-6101-4429-9cb8-5263dcca2f7a-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Lock "cinder-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" acquired by "delete_volume" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f966e3-8ea2-42be-8f30-bd22650da1aa]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:12 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:13 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c Sep 01 02:24:13 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:13 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" returned: 0 in 0.379s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:13 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c Sep 01 02:24:13 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:13 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" returned: 0 in 0.257s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c" released by "delete_volume" :: held 0.694s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Created reservations ['921d4f4c-c674-4c59-8599-7f464b841dc6', '20fe25ac-f670-4bf1-8914-77faedfaf75f', '90d1465d-96d7-4d34-8c2c-a296ba0022a3', '19bc4379-7c1f-4557-ac0e-11bd37c4086b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:13 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:13 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:13 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.260s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:13 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:24:13 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33455f0b-96d7-460c-ab3f-7f05305a46a2 tempest-ProjectMemberTests-846567292 None] Lock "cinder-727dd64a-71eb-466b-bfcb-b65fcdfc4f1c-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (387c4e49-47cf-49f5-aa34-c3413414fc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfa6580-c05f-409a-a2a4-d5bf209025a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbfa6580-c05f-409a-a2a4-d5bf209025a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320426231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ade0f19-62f1-40ab-af38-668d734937d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:14Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8271fcc7-89e5-43c1-86ea-3bd8dd81867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8271fcc7-89e5-43c1-86ea-3bd8dd81867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7a078b-4aae-4b15-aef6-0a69a203347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc7a078b-4aae-4b15-aef6-0a69a203347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ade0f19-62f1-40ab-af38-668d734937d2', 'volume_name': 'volume-0ade0f19-62f1-40ab-af38-668d734937d2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecd8698-0f51-4648-b1d1-cd023bee17a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ecd8698-0f51-4648-b1d1-cd023bee17a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b4b58d-c793-48b8-838c-6d10c48516d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:14 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Volume 0ade0f19-62f1-40ab-af38-668d734937d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ade0f19-62f1-40ab-af38-668d734937d2', 'volume_size': 1} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320426231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ade0f19-62f1-40ab-af38-668d734937d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:14Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Creating volume 0ade0f19-62f1-40ab-af38-668d734937d2 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:14 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:14 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 1073741824 Sep 01 02:24:14 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:14 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 1073741824" returned: 0 in 0.432s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:14 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:15 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 Sep 01 02:24:15 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:15 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2" returned: 0 in 0.258s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b4b58d-c793-48b8-838c-6d10c48516d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ade0f19-62f1-40ab-af38-668d734937d2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf29488-59a9-47d3-886d-656c0b7024a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:15 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Volume volume-0ade0f19-62f1-40ab-af38-668d734937d2 (0ade0f19-62f1-40ab-af38-668d734937d2): created successfully Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf29488-59a9-47d3-886d-656c0b7024a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (387c4e49-47cf-49f5-aa34-c3413414fc85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:15 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-829d0b17-f562-419c-b535-4bf41934241e tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Creating offline snapshot 3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 of volume 0ade0f19-62f1-40ab-af38-668d734937d2 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[778b0f66-c329-4937-ae58-822e6f645f2a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:15 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:15 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 Sep 01 02:24:15 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:16 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2" returned: 0 in 0.396s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:16 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 1G Sep 01 02:24:16 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:16 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 1G" returned: 0 in 0.427s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ade0f19-62f1-40ab-af38-668d734937d2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:16 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ade0f19-62f1-40ab-af38-668d734937d2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 Sep 01 02:24:16 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:16 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ade0f19-62f1-40ab-af38-668d734937d2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50" returned: 0 in 0.315s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:16 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 is being set with open permissions: ugo+rw Sep 01 02:24:16 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:16 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 Sep 01 02:24:16 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:17 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50" returned: 0 in 0.251s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:17 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.info Sep 01 02:24:17 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:17 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.info" returned: 0 in 0.249s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:17 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.info is being set with open permissions: ugo+rw Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:17 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.info Sep 01 02:24:17 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:17 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.info" returned: 0 in 0.269s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:17 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-c2e7eab4-dd16-4db8-b7da-527815cb0c4b tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Lock "cinder-3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-0ade0f19-62f1-40ab-af38-668d734937d2" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-0ade0f19-62f1-40ab-af38-668d734937d2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot 3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 of volume 0ade0f19-62f1-40ab-af38-668d734937d2 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae1768-eb11-4578-9cf7-e29b051a89c2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:17 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:18 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 Sep 01 02:24:18 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:18 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50" returned: 0 in 0.397s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ade0f19-62f1-40ab-af38-668d734937d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acbc5ac-ddb9-4ee6-8c31-b6889522f92b]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:18 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 Sep 01 02:24:18 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (8021154e-ae3d-4712-a8fc-7114af91aee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1bff2a-58f0-41fa-9016-7f8e6dfcd7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf1bff2a-58f0-41fa-9016-7f8e6dfcd7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288924702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abada83-f3b9-4417-831f-b5a4e1342445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:18Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9737c6ea-4510-4745-b5f8-f067d679c108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9737c6ea-4510-4745-b5f8-f067d679c108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb6b73b-f58f-47a0-b5db-c86dbbcf3fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fb6b73b-f58f-47a0-b5db-c86dbbcf3fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abada83-f3b9-4417-831f-b5a4e1342445', 'volume_name': 'volume-7abada83-f3b9-4417-831f-b5a4e1342445', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd0e033-a420-4abf-9642-4e97f0e2d367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd0e033-a420-4abf-9642-4e97f0e2d367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e3220c-926c-4e30-9091-862020f465dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:18 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Volume 7abada83-f3b9-4417-831f-b5a4e1342445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abada83-f3b9-4417-831f-b5a4e1342445', 'volume_size': 1} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288924702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abada83-f3b9-4417-831f-b5a4e1342445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:18Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Creating volume 7abada83-f3b9-4417-831f-b5a4e1342445 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:18 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:18 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 1073741824 Sep 01 02:24:18 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:18 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2" returned: 0 in 0.395s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:18 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:18 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 Sep 01 02:24:18 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 1073741824" returned: 0 in 0.453s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:19 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 Sep 01 02:24:19 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50" returned: 0 in 0.345s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:19 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50 Sep 01 02:24:19 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:19 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445" returned: 0 in 0.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e3220c-926c-4e30-9091-862020f465dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abada83-f3b9-4417-831f-b5a4e1342445', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2655f17e-a8b8-452a-80d5-ea9ef4cd2fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:19 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Volume volume-7abada83-f3b9-4417-831f-b5a4e1342445 (7abada83-f3b9-4417-831f-b5a4e1342445): created successfully Sep 01 02:24:19 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2655f17e-a8b8-452a-80d5-ea9ef4cd2fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (8021154e-ae3d-4712-a8fc-7114af91aee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2.3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50" released by "_delete_snapshot" :: held 1.546s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-be38e362-b0dd-42da-8eb7-559428567bf1 tempest-ProjectReaderTests-710576940 None] Created volume successfully. Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-0ade0f19-62f1-40ab-af38-668d734937d2" released by "delete_snapshot" :: held 1.573s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Created reservations ['126f91ac-e401-4917-93b6-7b824252f248', '62b24bcf-2970-4cd6-8eae-113846d05b14', '742ab529-b077-4747-975d-56a19c74d918', 'a234d11d-cdef-4155-b740-fd026c92e691'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:19 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9d0e8f4d-751a-4221-afd4-33c1c297bf56 tempest-ProjectMemberTests-846567292 None] Lock "cinder-3e209ca0-f2a3-4db1-89d8-58d0c3bf2d50-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-0ade0f19-62f1-40ab-af38-668d734937d2-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:19 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Lock "cinder-0ade0f19-62f1-40ab-af38-668d734937d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-0ade0f19-62f1-40ab-af38-668d734937d2" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-0ade0f19-62f1-40ab-af38-668d734937d2" acquired by "delete_volume" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bfdeda-3cbe-41a3-8235-e25f95733c25]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 Sep 01 02:24:20 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:20 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2" returned: 0 in 0.351s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2 Sep 01 02:24:20 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:20 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-0ade0f19-62f1-40ab-af38-668d734937d2" returned: 0 in 0.244s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-0ade0f19-62f1-40ab-af38-668d734937d2" released by "delete_volume" :: held 0.659s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Creating offline snapshot 3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 of volume 7abada83-f3b9-4417-831f-b5a4e1342445 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8ed6a8-4cc1-4a5f-965b-e87eee8677f2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Created reservations ['5f4ff6a8-16ae-460f-9fdf-78a35b961706', 'b9b1c533-dfe8-4428-875e-176cbc3c20e4', '272ecb4a-e357-422e-9285-d7783ee72a55', '0f22bd7d-67d7-4f52-8d44-c6a32a91023a'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:20 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:20 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:20 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:20 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 Sep 01 02:24:20 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.253s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:21 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-351bd8bb-4fb6-4d9e-8f69-6d8a559e299e tempest-ProjectMemberTests-846567292 None] Lock "cinder-0ade0f19-62f1-40ab-af38-668d734937d2-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:21 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445" returned: 0 in 0.409s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 1G Sep 01 02:24:21 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (0d997758-6c8e-4912-94ff-1010bd96ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e251e0-3796-40b0-a909-2eee11b7b5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:21 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 1G" returned: 0 in 0.485s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abada83-f3b9-4417-831f-b5a4e1342445 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abada83-f3b9-4417-831f-b5a4e1342445 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 Sep 01 02:24:21 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e251e0-3796-40b0-a909-2eee11b7b5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144835865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e819367b-d1fd-4643-9a65-a444761cedd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:22Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31474e2a-aa67-4215-82e4-b94871706b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31474e2a-aa67-4215-82e4-b94871706b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7154f599-f660-4039-abdc-638c7636537b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7154f599-f660-4039-abdc-638c7636537b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e819367b-d1fd-4643-9a65-a444761cedd5', 'volume_name': 'volume-e819367b-d1fd-4643-9a65-a444761cedd5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3f4a48-60c7-478e-922d-4ee9d2305e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3f4a48-60c7-478e-922d-4ee9d2305e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa55a39a-3749-4f87-9e95-4521ba8c334b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:21 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Volume e819367b-d1fd-4643-9a65-a444761cedd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e819367b-d1fd-4643-9a65-a444761cedd5', 'volume_size': 1} Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:21 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abada83-f3b9-4417-831f-b5a4e1342445 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3" returned: 0 in 0.290s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:21 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 is being set with open permissions: ugo+rw Sep 01 02:24:21 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:21 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 Sep 01 02:24:21 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3" returned: 0 in 0.240s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.info Sep 01 02:24:22 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.info" returned: 0 in 0.249s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.info is being set with open permissions: ugo+rw Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.info Sep 01 02:24:22 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.info" returned: 0 in 0.267s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.033s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144835865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e819367b-d1fd-4643-9a65-a444761cedd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:22Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Creating volume e819367b-d1fd-4643-9a65-a444761cedd5 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:22 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:22 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:22 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 1073741824 Sep 01 02:24:22 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:22 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-0becef1e-effe-4a83-8c6a-604a814e267f tempest-ProjectReaderTests-710576940 None] Create snapshot completed successfully Sep 01 02:24:23 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 1073741824" returned: 0 in 0.418s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:23 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 Sep 01 02:24:23 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:23 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5" returned: 0 in 0.253s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa55a39a-3749-4f87-9e95-4521ba8c334b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e819367b-d1fd-4643-9a65-a444761cedd5', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa452556-6388-4fd5-8379-5c6c24a25ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:23 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Volume volume-e819367b-d1fd-4643-9a65-a444761cedd5 (e819367b-d1fd-4643-9a65-a444761cedd5): created successfully Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa452556-6388-4fd5-8379-5c6c24a25ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (0d997758-6c8e-4912-94ff-1010bd96ba48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:23 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-5ddd244d-238b-43b9-9e39-ee321e89f4f7 tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Creating offline snapshot 34bb8e38-801d-46b4-b9ed-db733cca2446 of volume e819367b-d1fd-4643-9a65-a444761cedd5 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad93f66-afa9-45f6-9e99-3d0cd72194d8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:23 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:23 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 Sep 01 02:24:23 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-7abada83-f3b9-4417-831f-b5a4e1342445" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-7abada83-f3b9-4417-831f-b5a4e1342445" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Deleting offline snapshot 3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 of volume 7abada83-f3b9-4417-831f-b5a4e1342445 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] snapshot_file for this snap is: volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ab027-4721-456c-978e-5a50ca1ab8d0]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 Sep 01 02:24:24 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5" returned: 0 in 0.395s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 1G Sep 01 02:24:24 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3" returned: 0 in 0.364s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7abada83-f3b9-4417-831f-b5a4e1342445(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bbca93-a83e-44a9-9d52-d7baad1c566f]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 Sep 01 02:24:24 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 1G" returned: 0 in 0.398s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e819367b-d1fd-4643-9a65-a444761cedd5 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e819367b-d1fd-4643-9a65-a444761cedd5 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 Sep 01 02:24:24 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:24 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 Sep 01 02:24:24 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:24 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e819367b-d1fd-4643-9a65-a444761cedd5 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446" returned: 0 in 0.311s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:24 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 is being set with open permissions: ugo+rw Sep 01 02:24:24 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 Sep 01 02:24:25 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3" returned: 0 in 0.322s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446" returned: 0 in 0.271s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3 Sep 01 02:24:25 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.info Sep 01 02:24:25 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445.3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3" returned: 0 in 0.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3" released by "_delete_snapshot" :: held 1.434s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:25 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-7abada83-f3b9-4417-831f-b5a4e1342445" released by "delete_snapshot" :: held 1.460s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.info" returned: 0 in 0.257s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.info is being set with open permissions: ugo+rw Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:25 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.info Sep 01 02:24:25 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Created reservations ['0d5fc4b2-044f-4970-aab6-df4feb6a92cb', '5d472cec-4827-4d8c-b06b-4408a0bb05ee', '2a1b113d-dd32-4400-8b79-78375db66208', 'a1c12e56-12c8-4733-98c6-d2cc46c4b884'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Delete snapshot completed successfully. Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-33b7fc26-1a2b-4ed3-9c0f-81e1ab5b9510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-3614a6b8-4b8f-4d05-a78b-a6460dd1e9a3-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:25 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.info" returned: 0 in 0.251s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:25 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-66e5ef34-f955-455b-b221-262c69c68a66 tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-34bb8e38-801d-46b4-b9ed-db733cca2446-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Lock "cinder-34bb8e38-801d-46b4-b9ed-db733cca2446-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:25 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-e819367b-d1fd-4643-9a65-a444761cedd5" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-e819367b-d1fd-4643-9a65-a444761cedd5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-34bb8e38-801d-46b4-b9ed-db733cca2446" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-34bb8e38-801d-46b4-b9ed-db733cca2446" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot 34bb8e38-801d-46b4-b9ed-db733cca2446 of volume e819367b-d1fd-4643-9a65-a444761cedd5 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710b097-1e88-485f-8075-e0998ffbda4a]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 Sep 01 02:24:26 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-7abada83-f3b9-4417-831f-b5a4e1342445-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Lock "cinder-7abada83-f3b9-4417-831f-b5a4e1342445-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-7abada83-f3b9-4417-831f-b5a4e1342445" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-7abada83-f3b9-4417-831f-b5a4e1342445" acquired by "delete_volume" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[55323fce-14bc-42b9-9b30-186e400945ff]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 Sep 01 02:24:26 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446" returned: 0 in 0.392s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e819367b-d1fd-4643-9a65-a444761cedd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45425c3-2c5e-4086-baa2-ecdd095f4d06]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 Sep 01 02:24:26 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445" returned: 0 in 0.385s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445 Sep 01 02:24:26 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5" returned: 0 in 0.359s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:26 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 Sep 01 02:24:26 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:26 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7abada83-f3b9-4417-831f-b5a4e1342445" returned: 0 in 0.251s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:26 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-7abada83-f3b9-4417-831f-b5a4e1342445" released by "delete_volume" :: held 0.698s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Created reservations ['c6598420-126f-4175-8538-9a9c546023e5', 'a9f2344a-a3cb-4a37-b8ca-c01b38702eab', 'c7d39c48-ddef-43bd-997d-1a132ec5e0d9', '9f79e4d5-df1a-4cf7-9585-e5683cf52058'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:27 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:27 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:27 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446" returned: 0 in 0.377s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:27 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446 Sep 01 02:24:27 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:27 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.259s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Deleted volume successfully. Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-70ad5947-7d4e-4505-9a15-04a69801e0e6 tempest-ProjectReaderTests-710576940 None] Lock "cinder-7abada83-f3b9-4417-831f-b5a4e1342445-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:27 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5.34bb8e38-801d-46b4-b9ed-db733cca2446" returned: 0 in 0.274s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-34bb8e38-801d-46b4-b9ed-db733cca2446" released by "_delete_snapshot" :: held 1.501s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-e819367b-d1fd-4643-9a65-a444761cedd5" released by "delete_snapshot" :: held 1.527s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Created reservations ['9b9462de-ed93-48a8-a479-8a25fb7ac000', '09b12587-f49b-4e3c-b0d2-260bb781a3a8', '04b1f8b4-8184-4969-a1aa-9e050fedce71', 'c9c4bd18-72d5-43b5-a2c1-26d714447a57'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:27 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-eb8baa4b-24cc-461d-93c9-a1acaeb14eb7 tempest-ProjectMemberTests-846567292 None] Lock "cinder-34bb8e38-801d-46b4-b9ed-db733cca2446-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (2ec57e4e-873f-4fe9-b849-53b1bbd9b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90182d10-9fa7-454d-9026-dc16ac927294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90182d10-9fa7-454d-9026-dc16ac927294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069647475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb85765-5958-4832-b8df-20cdcc4f53be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:28Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddea0ba1-c7d2-4a10-9523-19595b147df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddea0ba1-c7d2-4a10-9523-19595b147df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e6244c-d547-4db2-bf00-b4c097fd2a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e6244c-d547-4db2-bf00-b4c097fd2a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb85765-5958-4832-b8df-20cdcc4f53be', 'volume_name': 'volume-ccb85765-5958-4832-b8df-20cdcc4f53be', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb78398-e2c5-4429-b92f-87c07cbad29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb78398-e2c5-4429-b92f-87c07cbad29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaafcf77-5a74-4846-b482-2ec349f14cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:27 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Volume ccb85765-5958-4832-b8df-20cdcc4f53be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb85765-5958-4832-b8df-20cdcc4f53be', 'volume_size': 1} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1069647475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb85765-5958-4832-b8df-20cdcc4f53be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:28Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Creating volume ccb85765-5958-4832-b8df-20cdcc4f53be {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:27 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:27 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:27 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be 1073741824 Sep 01 02:24:27 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-e819367b-d1fd-4643-9a65-a444761cedd5-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-e819367b-d1fd-4643-9a65-a444761cedd5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-e819367b-d1fd-4643-9a65-a444761cedd5" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-e819367b-d1fd-4643-9a65-a444761cedd5" acquired by "delete_volume" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[712d1ac4-e6a8-471b-b89b-b774d3a0856b]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 Sep 01 02:24:28 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be 1073741824" returned: 0 in 0.451s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be Sep 01 02:24:28 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:28 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5 Sep 01 02:24:28 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:28 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be" returned: 0 in 0.251s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaafcf77-5a74-4846-b482-2ec349f14cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb85765-5958-4832-b8df-20cdcc4f53be', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341adb94-d0a4-4b9c-b8d1-564ff564f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:28 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Volume volume-ccb85765-5958-4832-b8df-20cdcc4f53be (ccb85765-5958-4832-b8df-20cdcc4f53be): created successfully Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341adb94-d0a4-4b9c-b8d1-564ff564f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (2ec57e4e-873f-4fe9-b849-53b1bbd9b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:28 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-11b4ad23-7d3c-4c88-b95c-c75a813dfce0 tempest-ProjectReaderTests-710576940 None] Created volume successfully. Sep 01 02:24:28 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-e819367b-d1fd-4643-9a65-a444761cedd5" returned: 0 in 0.245s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-e819367b-d1fd-4643-9a65-a444761cedd5" released by "delete_volume" :: held 0.679s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:28 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Created reservations ['07de7041-3e10-4e17-99f2-96ab58707426', 'b3277f60-858f-4308-8b0e-1eb66b63d980', 'fe449e0c-7a36-4c6e-9ac0-c8aed9ea9b60', '1cc4b362-9eeb-46b2-9bd1-5b67225cae78'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Creating offline snapshot 06d22b25-f4a5-472b-a36a-d93cd4cd933e of volume ccb85765-5958-4832-b8df-20cdcc4f53be {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dada668-fb12-4924-a167-5c4221a142b3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:29 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:29 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:29 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be Sep 01 02:24:29 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:29 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.250s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:29 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-faa869e3-1d56-416d-8e0a-8aa37d83cfa9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-e819367b-d1fd-4643-9a65-a444761cedd5-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:29 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be" returned: 0 in 0.378s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:29 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e 1G Sep 01 02:24:29 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (cccc0dc5-22d6-4006-9b54-c73036dc6811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99140fc3-c7c4-4723-b9ab-cb9ebbff5737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99140fc3-c7c4-4723-b9ab-cb9ebbff5737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-146197014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f897270-ee7b-479b-b54b-f7d8a5247ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:30Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9069eb-84ce-4727-a7fc-6e9032003a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9069eb-84ce-4727-a7fc-6e9032003a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e637f92-9271-4349-a533-0046a0f6b879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:29 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e637f92-9271-4349-a533-0046a0f6b879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f897270-ee7b-479b-b54b-f7d8a5247ca8', 'volume_name': 'volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd37fd4-027d-4b34-b4e2-add5e045dfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd37fd4-027d-4b34-b4e2-add5e045dfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5bd68c-4fac-47a4-8036-1b1c8bd3827d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:29 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Volume 3f897270-ee7b-479b-b54b-f7d8a5247ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8', 'volume_size': 1} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e 1G" returned: 0 in 0.438s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:29 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb85765-5958-4832-b8df-20cdcc4f53be -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:29 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb85765-5958-4832-b8df-20cdcc4f53be -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e Sep 01 02:24:29 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccb85765-5958-4832-b8df-20cdcc4f53be -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e" returned: 0 in 0.280s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:30 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e is being set with open permissions: ugo+rw Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e Sep 01 02:24:30 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e" returned: 0 in 0.237s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.info Sep 01 02:24:30 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.info" returned: 0 in 0.242s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:30 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.info is being set with open permissions: ugo+rw Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.info Sep 01 02:24:30 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.info" returned: 0 in 0.238s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.048s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-146197014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f897270-ee7b-479b-b54b-f7d8a5247ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:30Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Creating volume 3f897270-ee7b-479b-b54b-f7d8a5247ca8 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:30 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:30 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:30 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 1073741824 Sep 01 02:24:30 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:30 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-b2125766-b978-4288-ab72-86f53500a19a tempest-ProjectReaderTests-710576940 None] Create snapshot completed successfully Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-06d22b25-f4a5-472b-a36a-d93cd4cd933e-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Lock "cinder-06d22b25-f4a5-472b-a36a-d93cd4cd933e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-ccb85765-5958-4832-b8df-20cdcc4f53be" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-ccb85765-5958-4832-b8df-20cdcc4f53be" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-06d22b25-f4a5-472b-a36a-d93cd4cd933e" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-06d22b25-f4a5-472b-a36a-d93cd4cd933e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Deleting offline snapshot 06d22b25-f4a5-472b-a36a-d93cd4cd933e of volume ccb85765-5958-4832-b8df-20cdcc4f53be {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] snapshot_file for this snap is: volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fc1141-c361-4f24-a5b3-8634a070961d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:31 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e Sep 01 02:24:31 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:31 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 1073741824" returned: 0 in 0.451s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:31 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 Sep 01 02:24:31 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:31 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e" returned: 0 in 0.401s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccb85765-5958-4832-b8df-20cdcc4f53be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[04929ad6-6219-4b69-a7c2-ef64f0eef1c3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:31 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8" returned: 0 in 0.262s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5bd68c-4fac-47a4-8036-1b1c8bd3827d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cec43f6-04df-4fce-aa28-b616c889a7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:31 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Volume volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 (3f897270-ee7b-479b-b54b-f7d8a5247ca8): created successfully Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cec43f6-04df-4fce-aa28-b616c889a7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:31 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (cccc0dc5-22d6-4006-9b54-c73036dc6811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:31 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fa4d8e1a-40af-49ee-8710-8fe1db5b9698 tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:24:31 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be Sep 01 02:24:31 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:32 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be" returned: 0 in 0.396s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Creating offline snapshot 5b629eda-b931-43ca-9c05-04094187e580 of volume 3f897270-ee7b-479b-b54b-f7d8a5247ca8 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:32 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e Sep 01 02:24:32 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[910f5b02-037f-4a65-8ada-78f63bb8bfaa]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:32 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 Sep 01 02:24:32 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:32 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e" returned: 0 in 0.342s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:32 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e Sep 01 02:24:32 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:32 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8" returned: 0 in 0.385s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:32 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 1G Sep 01 02:24:32 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:32 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be.06d22b25-f4a5-472b-a36a-d93cd4cd933e" returned: 0 in 0.257s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-06d22b25-f4a5-472b-a36a-d93cd4cd933e" released by "_delete_snapshot" :: held 1.488s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-ccb85765-5958-4832-b8df-20cdcc4f53be" released by "delete_snapshot" :: held 1.515s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Created reservations ['1834c2db-c443-411b-80d1-609be2064c85', '6f316d7e-71f8-4d3a-ae47-0e0a840ceee8', '6bbd9c7e-9cf6-414a-91a8-13bb6fc39fbd', '6624baeb-710b-4124-92ac-8dbf18be8054'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:32 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Delete snapshot completed successfully. Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-87550656-d41c-4f93-aa54-a645cee367b0 tempest-ProjectReaderTests-710576940 None] Lock "cinder-06d22b25-f4a5-472b-a36a-d93cd4cd933e-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:32 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 1G" returned: 0 in 0.427s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:32 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:32 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 Sep 01 02:24:32 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580" returned: 0 in 0.286s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 is being set with open permissions: ugo+rw Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 Sep 01 02:24:33 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-ccb85765-5958-4832-b8df-20cdcc4f53be-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-ccb85765-5958-4832-b8df-20cdcc4f53be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-ccb85765-5958-4832-b8df-20cdcc4f53be" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-ccb85765-5958-4832-b8df-20cdcc4f53be" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[401670e3-375b-40ba-ab5b-9b53c63221a2]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580" returned: 0 in 0.258s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.info Sep 01 02:24:33 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be Sep 01 02:24:33 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.info" returned: 0 in 0.246s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.info is being set with open permissions: ugo+rw Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.info Sep 01 02:24:33 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be" returned: 0 in 0.374s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:33 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be Sep 01 02:24:33 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:33 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.info" returned: 0 in 0.247s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:33 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-1a64349c-f649-40fe-aaf5-d7e558b30bd4 tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:24:34 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ccb85765-5958-4832-b8df-20cdcc4f53be" returned: 0 in 0.262s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-ccb85765-5958-4832-b8df-20cdcc4f53be" released by "delete_volume" :: held 0.699s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Created reservations ['dd5e3286-3150-4396-a0d1-e2a4f59df2ea', 'bad2271a-6e98-4a95-ad42-faa00c38cc5c', 'ae6ef3ba-59e3-4c0e-b06b-36089d099d4e', '36b9436b-44b7-46a4-b7cd-36a347a33d57'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-5b629eda-b931-43ca-9c05-04094187e580-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Lock "cinder-5b629eda-b931-43ca-9c05-04094187e580-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-3f897270-ee7b-479b-b54b-f7d8a5247ca8" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-3f897270-ee7b-479b-b54b-f7d8a5247ca8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-5b629eda-b931-43ca-9c05-04094187e580" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-5b629eda-b931-43ca-9c05-04094187e580" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot 5b629eda-b931-43ca-9c05-04094187e580 of volume 3f897270-ee7b-479b-b54b-f7d8a5247ca8 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:34 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:34 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aa06c3-c2b7-4459-a47f-2cdac52bdc54]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:34 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 Sep 01 02:24:34 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:34 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Deleted volume successfully. Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-93e0eded-58a0-4a19-bea8-679e4b847510 tempest-ProjectReaderTests-710576940 None] Lock "cinder-ccb85765-5958-4832-b8df-20cdcc4f53be-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:34 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580" returned: 0 in 0.389s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8212b447-cc1a-4b6d-b138-479dcc98a846]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:34 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 Sep 01 02:24:34 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (0dd299aa-7325-423c-bbc2-bc28f8b3c7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8591ac09-1e13-4641-b564-437e9929ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8591ac09-1e13-4641-b564-437e9929ea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89259471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2801bb-cfc3-46df-92f9-409efd4e2650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:35Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ed7526-d947-458b-94e4-c5fa09ac1f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13ed7526-d947-458b-94e4-c5fa09ac1f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b461b306-0333-4586-ba5d-21b9bac7fe89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b461b306-0333-4586-ba5d-21b9bac7fe89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2801bb-cfc3-46df-92f9-409efd4e2650', 'volume_name': 'volume-ad2801bb-cfc3-46df-92f9-409efd4e2650', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8699ecb5-e1ce-4bd6-afa6-a0f130e8bf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8699ecb5-e1ce-4bd6-afa6-a0f130e8bf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9fb1ff-7ccc-4542-bcbf-180c4fe0e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Volume ad2801bb-cfc3-46df-92f9-409efd4e2650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2801bb-cfc3-46df-92f9-409efd4e2650', 'volume_size': 1} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89259471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2801bb-cfc3-46df-92f9-409efd4e2650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:35Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Creating volume ad2801bb-cfc3-46df-92f9-409efd4e2650 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:35 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:35 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 1073741824 Sep 01 02:24:35 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8" returned: 0 in 0.387s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:35 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 Sep 01 02:24:35 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:35 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580" returned: 0 in 0.327s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:35 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580 Sep 01 02:24:35 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:35 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 1073741824" returned: 0 in 0.450s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:35 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 Sep 01 02:24:35 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:35 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8.5b629eda-b931-43ca-9c05-04094187e580" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-5b629eda-b931-43ca-9c05-04094187e580" released by "_delete_snapshot" :: held 1.461s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-3f897270-ee7b-479b-b54b-f7d8a5247ca8" released by "delete_snapshot" :: held 1.506s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Created reservations ['db55376e-be52-4ae5-8da3-dad139dcdb3a', '31c8637f-98f7-4387-b317-9e556a43b406', 'b8c14a43-44f5-4d43-a810-93d928c6f4cd', '8c35198f-8197-489d-9030-11f27fb0dcea'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:35 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650" returned: 0 in 0.263s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9fb1ff-7ccc-4542-bcbf-180c4fe0e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2801bb-cfc3-46df-92f9-409efd4e2650', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329af3e6-72fd-4473-99aa-417295782d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:35 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Volume volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 (ad2801bb-cfc3-46df-92f9-409efd4e2650): created successfully Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329af3e6-72fd-4473-99aa-417295782d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (0dd299aa-7325-423c-bbc2-bc28f8b3c7b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:24:35 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-da97c2ee-30a4-424f-8df0-91dbbdf16923 tempest-ProjectMemberTests-846567292 None] Lock "cinder-5b629eda-b931-43ca-9c05-04094187e580-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:35 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7e211550-c522-400b-a403-89bc35ddfd10 tempest-ProjectReaderTests-710576940 None] Created volume successfully. Sep 01 02:24:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-3f897270-ee7b-479b-b54b-f7d8a5247ca8-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Lock "cinder-3f897270-ee7b-479b-b54b-f7d8a5247ca8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-3f897270-ee7b-479b-b54b-f7d8a5247ca8" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:36 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-3f897270-ee7b-479b-b54b-f7d8a5247ca8" acquired by "delete_volume" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:36 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cb3721-091d-4671-a29d-034df16084ed]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:36 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 Sep 01 02:24:36 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:36 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8" returned: 0 in 0.365s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:36 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8 Sep 01 02:24:36 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:37 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-3f897270-ee7b-479b-b54b-f7d8a5247ca8" returned: 0 in 0.265s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-3f897270-ee7b-479b-b54b-f7d8a5247ca8" released by "delete_volume" :: held 0.696s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Created reservations ['d1709fd8-38a4-45a4-8aba-13efadac2660', '70a1213e-dd0b-46e6-b1ea-6c5f9236c6b7', '13aa8e48-c648-40e4-b7b8-6e7a6f0e19e0', 'e3b978b4-a865-46cc-9249-76313cc4ef7d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Creating offline snapshot 6edee2db-a490-4f92-9e41-857fa10fbad0 of volume ad2801bb-cfc3-46df-92f9-409efd4e2650 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c26f50a-21f8-49a3-9603-b7b4716146ce]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:37 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:37 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:37 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 Sep 01 02:24:37 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:37 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.249s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-a140bdca-ccf9-4916-b4e5-a0fa3e6593cf tempest-ProjectMemberTests-846567292 None] Lock "cinder-3f897270-ee7b-479b-b54b-f7d8a5247ca8-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:37 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650" returned: 0 in 0.406s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:37 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 1G Sep 01 02:24:37 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (aac8f5dc-de0b-4baa-aae7-4e48d83cfc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc2cf2e-8336-4983-9708-5fe576d453ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc2cf2e-8336-4983-9708-5fe576d453ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908412935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10da7e3-5016-4cc8-801c-d82d822227d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:38Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab7aaf0-a5b5-44a0-a246-7813d372caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab7aaf0-a5b5-44a0-a246-7813d372caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a376c9dd-e3f8-48c4-a8ff-aec0eeaadce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a376c9dd-e3f8-48c4-a8ff-aec0eeaadce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b10da7e3-5016-4cc8-801c-d82d822227d2', 'volume_name': 'volume-b10da7e3-5016-4cc8-801c-d82d822227d2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613e6be8-0414-4185-af73-ca26854fdcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:38 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613e6be8-0414-4185-af73-ca26854fdcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc4f95-025a-4a8d-b8b5-58c80baac212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:38 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Volume b10da7e3-5016-4cc8-801c-d82d822227d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b10da7e3-5016-4cc8-801c-d82d822227d2', 'volume_size': 1} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 1G" returned: 0 in 0.448s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:38 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 Sep 01 02:24:38 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:38 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0" returned: 0 in 0.288s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:38 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 is being set with open permissions: ugo+rw Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:38 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 Sep 01 02:24:38 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:38 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:38 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.info Sep 01 02:24:38 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:38 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.info" returned: 0 in 0.269s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:38 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.info is being set with open permissions: ugo+rw Sep 01 02:24:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:38 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.info Sep 01 02:24:38 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:39 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.info" returned: 0 in 0.253s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.125s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908412935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b10da7e3-5016-4cc8-801c-d82d822227d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:38Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Creating volume b10da7e3-5016-4cc8-801c-d82d822227d2 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:39 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:39 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 1073741824 Sep 01 02:24:39 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fd665486-5a67-4ef6-92af-1d5fc1ca53e4 tempest-ProjectReaderTests-710576940 None] Create snapshot completed successfully Sep 01 02:24:39 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 1073741824" returned: 0 in 0.406s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:39 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 Sep 01 02:24:39 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:39 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2" returned: 0 in 0.245s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffc4f95-025a-4a8d-b8b5-58c80baac212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b10da7e3-5016-4cc8-801c-d82d822227d2', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bcbe24-e55c-4442-8723-1ec593c3cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:39 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Volume volume-b10da7e3-5016-4cc8-801c-d82d822227d2 (b10da7e3-5016-4cc8-801c-d82d822227d2): created successfully Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bcbe24-e55c-4442-8723-1ec593c3cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:39 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (aac8f5dc-de0b-4baa-aae7-4e48d83cfc5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:39 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9f481b5e-ec67-4e47-a71c-9e99628cdf0c tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Creating offline snapshot 511b7bc8-0e54-4146-887e-3002b3b6bcbd of volume b10da7e3-5016-4cc8-801c-d82d822227d2 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab7b750-1cb3-4e56-90ae-6a71c1c711d4]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-6edee2db-a490-4f92-9e41-857fa10fbad0-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:40 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 Sep 01 02:24:40 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Lock "cinder-6edee2db-a490-4f92-9e41-857fa10fbad0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-ad2801bb-cfc3-46df-92f9-409efd4e2650" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-ad2801bb-cfc3-46df-92f9-409efd4e2650" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-6edee2db-a490-4f92-9e41-857fa10fbad0" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-6edee2db-a490-4f92-9e41-857fa10fbad0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Deleting offline snapshot 6edee2db-a490-4f92-9e41-857fa10fbad0 of volume ad2801bb-cfc3-46df-92f9-409efd4e2650 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] snapshot_file for this snap is: volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e805f3b-6ce8-4680-8dfc-91ca7ba94a3d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:40 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 Sep 01 02:24:40 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:40 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2" returned: 0 in 0.386s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:40 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd 1G Sep 01 02:24:40 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:40 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0" returned: 0 in 0.381s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad2801bb-cfc3-46df-92f9-409efd4e2650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9997a8ee-7999-4e6a-b0db-ae6b9b699295]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:40 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 Sep 01 02:24:41 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:41 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd 1G" returned: 0 in 0.403s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b10da7e3-5016-4cc8-801c-d82d822227d2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b10da7e3-5016-4cc8-801c-d82d822227d2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd Sep 01 02:24:41 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:41 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650" returned: 0 in 0.416s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 Sep 01 02:24:41 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:41 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b10da7e3-5016-4cc8-801c-d82d822227d2 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd" returned: 0 in 0.310s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd is being set with open permissions: ugo+rw Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd Sep 01 02:24:41 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:41 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0" returned: 0 in 0.360s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd" returned: 0 in 0.296s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0 Sep 01 02:24:41 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.info Sep 01 02:24:41 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:41 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650.6edee2db-a490-4f92-9e41-857fa10fbad0" returned: 0 in 0.256s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-6edee2db-a490-4f92-9e41-857fa10fbad0" released by "_delete_snapshot" :: held 1.504s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-ad2801bb-cfc3-46df-92f9-409efd4e2650" released by "delete_snapshot" :: held 1.528s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:41 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.info" returned: 0 in 0.261s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:41 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.info is being set with open permissions: ugo+rw Sep 01 02:24:41 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:41 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.info Sep 01 02:24:41 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Created reservations ['86eec404-6e3e-4b6b-8334-0adc7258c073', 'c43b5839-5151-40a7-89ee-a2c019d111e7', '17cd2841-70e2-4d65-b79d-a7f9cb5f621f', '42d82922-c9b3-4fdf-9cd5-ce3b911b7332'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Delete snapshot completed successfully. Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fe2e2ac9-494a-4792-b22e-00f5e9e39d93 tempest-ProjectReaderTests-710576940 None] Lock "cinder-6edee2db-a490-4f92-9e41-857fa10fbad0-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:42 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.info" returned: 0 in 0.244s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.992s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:42 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-12cb59ec-09ad-44ba-9986-87a1a9372337 tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-511b7bc8-0e54-4146-887e-3002b3b6bcbd-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Lock "cinder-511b7bc8-0e54-4146-887e-3002b3b6bcbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-b10da7e3-5016-4cc8-801c-d82d822227d2" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b10da7e3-5016-4cc8-801c-d82d822227d2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-511b7bc8-0e54-4146-887e-3002b3b6bcbd" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-511b7bc8-0e54-4146-887e-3002b3b6bcbd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot 511b7bc8-0e54-4146-887e-3002b3b6bcbd of volume b10da7e3-5016-4cc8-801c-d82d822227d2 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cc7614-656a-4e05-a379-ad56aeae4f23]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-ad2801bb-cfc3-46df-92f9-409efd4e2650-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Lock "cinder-ad2801bb-cfc3-46df-92f9-409efd4e2650-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:42 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd Sep 01 02:24:42 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-ad2801bb-cfc3-46df-92f9-409efd4e2650" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-ad2801bb-cfc3-46df-92f9-409efd4e2650" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fef1ff-e989-49b8-9c3e-be5793b5ae15]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:42 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 Sep 01 02:24:42 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:42 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd" returned: 0 in 0.379s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b10da7e3-5016-4cc8-801c-d82d822227d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc894ae-2296-4ad0-87c3-0c88fc2c813e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:42 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 Sep 01 02:24:42 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650" returned: 0 in 0.388s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:43 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650 Sep 01 02:24:43 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2" returned: 0 in 0.381s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:43 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd Sep 01 02:24:43 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ad2801bb-cfc3-46df-92f9-409efd4e2650" returned: 0 in 0.261s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-ad2801bb-cfc3-46df-92f9-409efd4e2650" released by "delete_volume" :: held 0.711s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Created reservations ['3e975390-b19a-45e7-a81e-fa3e064e386d', '95fa3e09-f761-4d37-b5fd-c1f7b1d17de9', '11d120ac-0dc8-41f4-a822-7c3362dd6107', '31c0e844-296e-4cbe-a0aa-3a4884b9c5e8'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:43 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:43 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd" returned: 0 in 0.399s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:43 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd Sep 01 02:24:43 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:43 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.283s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Deleted volume successfully. Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-6c6c8419-3a1d-48ab-8c24-86b3d2110f7f tempest-ProjectReaderTests-710576940 None] Lock "cinder-ad2801bb-cfc3-46df-92f9-409efd4e2650-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:43 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2.511b7bc8-0e54-4146-887e-3002b3b6bcbd" returned: 0 in 0.268s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-511b7bc8-0e54-4146-887e-3002b3b6bcbd" released by "_delete_snapshot" :: held 1.535s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b10da7e3-5016-4cc8-801c-d82d822227d2" released by "delete_snapshot" :: held 1.565s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Created reservations ['0a7afcf3-3eb5-4d34-9357-7d0802988f2b', '4b55db9d-346c-472a-a68f-ea8b6583e6e5', '92e1423e-9c47-4c40-88f9-3dac09b01894', '0912e35d-11f9-4965-8797-69390b2c064b'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:44 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f48a0621-26c0-4701-873a-e0c1a7ef5a99 tempest-ProjectMemberTests-846567292 None] Lock "cinder-511b7bc8-0e54-4146-887e-3002b3b6bcbd-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (b90954c5-b94f-42b0-8ecc-94b91cc90590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6aeaa8-f59e-4083-8480-573e7b04af78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6aeaa8-f59e-4083-8480-573e7b04af78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378534284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9342775-3401-4d7b-a2ee-6da41f4e9658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:44Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ec1ead-f680-4929-bba5-710c23a29254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ec1ead-f680-4929-bba5-710c23a29254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003b7a6d-b949-46d8-a41a-bca0b26fcf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003b7a6d-b949-46d8-a41a-bca0b26fcf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9342775-3401-4d7b-a2ee-6da41f4e9658', 'volume_name': 'volume-f9342775-3401-4d7b-a2ee-6da41f4e9658', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5928ddfe-17dd-4368-8a94-6b06d8889903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5928ddfe-17dd-4368-8a94-6b06d8889903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191b6f46-443f-4fd3-8042-ba493671a689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:44 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Volume f9342775-3401-4d7b-a2ee-6da41f4e9658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9342775-3401-4d7b-a2ee-6da41f4e9658', 'volume_size': 1} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1378534284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9342775-3401-4d7b-a2ee-6da41f4e9658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:44Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Creating volume f9342775-3401-4d7b-a2ee-6da41f4e9658 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:44 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:44 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 1073741824 Sep 01 02:24:44 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-b10da7e3-5016-4cc8-801c-d82d822227d2-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Lock "cinder-b10da7e3-5016-4cc8-801c-d82d822227d2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-b10da7e3-5016-4cc8-801c-d82d822227d2" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b10da7e3-5016-4cc8-801c-d82d822227d2" acquired by "delete_volume" :: waited 0.022s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6427aa-2e4c-4ac1-b00a-ef7f6f0257cd]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:44 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 1073741824" returned: 0 in 0.462s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:44 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 Sep 01 02:24:44 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:44 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 Sep 01 02:24:44 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658" returned: 0 in 0.249s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191b6f46-443f-4fd3-8042-ba493671a689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9342775-3401-4d7b-a2ee-6da41f4e9658', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:45 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117fefd0-60f0-46c1-b259-430c11936912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Volume volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 (f9342775-3401-4d7b-a2ee-6da41f4e9658): created successfully Sep 01 02:24:45 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2 Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117fefd0-60f0-46c1-b259-430c11936912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:45 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (b90954c5-b94f-42b0-8ecc-94b91cc90590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-650312d7-e782-4aa3-8d43-6ad0941495f8 tempest-ProjectReaderTests-710576940 None] Created volume successfully. Sep 01 02:24:45 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-b10da7e3-5016-4cc8-801c-d82d822227d2" returned: 0 in 0.275s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b10da7e3-5016-4cc8-801c-d82d822227d2" released by "delete_volume" :: held 0.725s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Creating offline snapshot b17fd22e-a90f-40a1-9ac8-af4056f6d87b of volume f9342775-3401-4d7b-a2ee-6da41f4e9658 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13b849e-c297-4928-9f9e-144976462e9e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Created reservations ['cbda8b00-a133-4b52-8ca2-f99c3e3ce5f6', '676a8574-7cbf-4d2b-b28a-4f8a4ed9b99d', '56868a83-1dc1-4c48-805b-59c739377a8b', 'f35c967a-3737-4689-9227-b86b3c94a4da'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 Sep 01 02:24:45 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:45 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:45 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.274s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-62729c8b-f46b-4fc5-8120-904ca1e651e8 tempest-ProjectMemberTests-846567292 None] Lock "cinder-b10da7e3-5016-4cc8-801c-d82d822227d2-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:45 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658" returned: 0 in 0.421s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:45 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b 1G Sep 01 02:24:45 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (cdf56b3c-22db-44bd-bc66-f41c57552d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eae11b-1f25-4358-bf0a-5a6ca99edf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:46 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71eae11b-1f25-4358-bf0a-5a6ca99edf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141634408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7766a410-fd11-4972-af36-b082bf248c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:46Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20cf138-ecf6-4afa-a66b-ec80b872543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20cf138-ecf6-4afa-a66b-ec80b872543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01313f93-0b31-4707-b523-1aaaa1d7ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01313f93-0b31-4707-b523-1aaaa1d7ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7766a410-fd11-4972-af36-b082bf248c1f', 'volume_name': 'volume-7766a410-fd11-4972-af36-b082bf248c1f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df7a669-fb21-4701-852e-954b94ee0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df7a669-fb21-4701-852e-954b94ee0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e43095-84aa-4af2-93fe-6b4897e67c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:46 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Volume 7766a410-fd11-4972-af36-b082bf248c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7766a410-fd11-4972-af36-b082bf248c1f', 'volume_size': 1} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b 1G" returned: 0 in 0.479s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:46 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b Sep 01 02:24:46 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:46 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b" returned: 0 in 0.305s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b is being set with open permissions: ugo+rw Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:46 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b Sep 01 02:24:46 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:46 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b" returned: 0 in 0.254s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:46 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.info Sep 01 02:24:46 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:47 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.info" returned: 0 in 0.259s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:47 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.info is being set with open permissions: ugo+rw Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:47 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.info Sep 01 02:24:47 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:47 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.info" returned: 0 in 0.245s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.115s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141634408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7766a410-fd11-4972-af36-b082bf248c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='811b8c6835e74046a1a40da2d497a808',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:46Z,use_quota=True,user_id='e9a91ab8392345d282a619036de6ea35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Creating volume 7766a410-fd11-4972-af36-b082bf248c1f {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:47 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:47 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f 1073741824 Sep 01 02:24:47 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-edfea0ed-e93a-42c6-ad9d-1e758da05f86 tempest-ProjectReaderTests-710576940 None] Create snapshot completed successfully Sep 01 02:24:47 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f 1073741824" returned: 0 in 0.392s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:47 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f Sep 01 02:24:47 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f" returned: 0 in 0.245s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e43095-84aa-4af2-93fe-6b4897e67c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7766a410-fd11-4972-af36-b082bf248c1f', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6ba476-6e8d-4d47-a39d-9e8ab8988003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:48 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Volume volume-7766a410-fd11-4972-af36-b082bf248c1f (7766a410-fd11-4972-af36-b082bf248c1f): created successfully Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6ba476-6e8d-4d47-a39d-9e8ab8988003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Flow 'volume_create_manager' (cdf56b3c-22db-44bd-bc66-f41c57552d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:48 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-da505daf-1f18-4275-ab7f-3a1ac5593b57 tempest-ProjectMemberTests-846567292 None] Created volume successfully. Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Creating offline snapshot b5935431-7dac-43e8-bbad-9b163b9d534e of volume 7766a410-fd11-4972-af36-b082bf248c1f {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3b47da-4639-46bf-95eb-ed2a1d928c74]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-b17fd22e-a90f-40a1-9ac8-af4056f6d87b-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Lock "cinder-b17fd22e-a90f-40a1-9ac8-af4056f6d87b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-f9342775-3401-4d7b-a2ee-6da41f4e9658" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-f9342775-3401-4d7b-a2ee-6da41f4e9658" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-b17fd22e-a90f-40a1-9ac8-af4056f6d87b" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:48 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f Sep 01 02:24:48 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-b17fd22e-a90f-40a1-9ac8-af4056f6d87b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Deleting offline snapshot b17fd22e-a90f-40a1-9ac8-af4056f6d87b of volume f9342775-3401-4d7b-a2ee-6da41f4e9658 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] snapshot_file for this snap is: volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ff4ee-9701-486a-aa30-70153cd4ae0d]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b Sep 01 02:24:48 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:48 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:48 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:48 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e 1G Sep 01 02:24:48 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b" returned: 0 in 0.385s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9342775-3401-4d7b-a2ee-6da41f4e9658(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade6b972-d77b-48ce-88c7-4867fd5b8da4]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 Sep 01 02:24:49 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e 1G" returned: 0 in 0.416s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7766a410-fd11-4972-af36-b082bf248c1f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7766a410-fd11-4972-af36-b082bf248c1f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e Sep 01 02:24:49 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658" returned: 0 in 0.413s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b Sep 01 02:24:49 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7766a410-fd11-4972-af36-b082bf248c1f -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e" returned: 0 in 0.317s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e is being set with open permissions: ugo+rw Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e Sep 01 02:24:49 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b" returned: 0 in 0.354s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:49 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b Sep 01 02:24:49 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:49 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e" returned: 0 in 0.290s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:49 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:50 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.info Sep 01 02:24:50 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:50 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658.b17fd22e-a90f-40a1-9ac8-af4056f6d87b" returned: 0 in 0.264s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-b17fd22e-a90f-40a1-9ac8-af4056f6d87b" released by "_delete_snapshot" :: held 1.527s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-f9342775-3401-4d7b-a2ee-6da41f4e9658" released by "delete_snapshot" :: held 1.553s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:50 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Created reservations ['1514e39e-ee02-476e-9758-17a5ff073c10', 'e693efde-8feb-43c7-bbc6-c7f68bf2aed0', '0c26a331-7269-4936-9d1c-383c16c5d4d8', '4ffb01ee-6158-4038-a1f6-1f04fb7ae92f'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.info" returned: 0 in 0.292s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:50 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.info is being set with open permissions: ugo+rw Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:50 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.info Sep 01 02:24:50 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:50 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Delete snapshot completed successfully. Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-8d7eac27-91a2-48ac-b9ff-2fa2526bf07e tempest-ProjectReaderTests-710576940 None] Lock "cinder-b17fd22e-a90f-40a1-9ac8-af4056f6d87b-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:50 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.info" returned: 0 in 0.245s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:50 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-a2719459-4fb5-4619-b078-3e0fabc32bda tempest-ProjectMemberTests-846567292 None] Create snapshot completed successfully Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-f9342775-3401-4d7b-a2ee-6da41f4e9658-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Lock "cinder-f9342775-3401-4d7b-a2ee-6da41f4e9658-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-f9342775-3401-4d7b-a2ee-6da41f4e9658" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-f9342775-3401-4d7b-a2ee-6da41f4e9658" acquired by "delete_volume" :: waited 0.013s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5ff2e7-54ca-4683-b806-e8b238307d18]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:50 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:50 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 Sep 01 02:24:50 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:51 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658" returned: 0 in 0.379s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:51 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658 Sep 01 02:24:51 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:51 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-f9342775-3401-4d7b-a2ee-6da41f4e9658" returned: 0 in 0.258s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-f9342775-3401-4d7b-a2ee-6da41f4e9658" released by "delete_volume" :: held 0.690s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Created reservations ['a41b9965-b164-4ccc-8a88-b13ffc6d0457', '0b63a8e0-3472-4b0a-9dc1-4eab7804037d', 'bf05caf7-3ba8-42e4-86ac-926bf3bc369f', '3ea673e6-4c92-4b4c-9a24-75dc020a1698'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:51 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:51 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-b5935431-7dac-43e8-bbad-9b163b9d534e-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-b5935431-7dac-43e8-bbad-9b163b9d534e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-7766a410-fd11-4972-af36-b082bf248c1f" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-7766a410-fd11-4972-af36-b082bf248c1f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-b5935431-7dac-43e8-bbad-9b163b9d534e" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b5935431-7dac-43e8-bbad-9b163b9d534e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Deleting offline snapshot b5935431-7dac-43e8-bbad-9b163b9d534e of volume 7766a410-fd11-4972-af36-b082bf248c1f {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] snapshot_file for this snap is: volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[025e448d-36c4-42b4-95ca-6ebfaec1aa92]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:51 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.298s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:51 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Deleted volume successfully. Sep 01 02:24:51 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-9a49f4ad-bfbf-4037-906c-3d35fd27ade3 tempest-ProjectReaderTests-710576940 None] Lock "cinder-f9342775-3401-4d7b-a2ee-6da41f4e9658-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:52 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e Sep 01 02:24:52 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:52 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e" returned: 0 in 0.401s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7766a410-fd11-4972-af36-b082bf248c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[489a0867-255c-4468-abf2-59b3239dd933]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (af4a5599-56f9-4f2c-968e-c8a0b5a92fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a5ae45-c3e2-40b0-9d85-afa04e624ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a5ae45-c3e2-40b0-9d85-afa04e624ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290365228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd94d6a2-310d-4b07-99cc-1891f68e5287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:52Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:52 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f Sep 01 02:24:52 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cad1be-da84-41ab-bfc8-a9ad557099f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87cad1be-da84-41ab-bfc8-a9ad557099f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7c78b0-924c-4590-a3d6-b4c391c34a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7c78b0-924c-4590-a3d6-b4c391c34a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd94d6a2-310d-4b07-99cc-1891f68e5287', 'volume_name': 'volume-fd94d6a2-310d-4b07-99cc-1891f68e5287', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44986fb3-1cbc-46d5-8fd7-9c7523b496bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44986fb3-1cbc-46d5-8fd7-9c7523b496bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773e10a5-3bd0-440f-9f11-c626f425046c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:52 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Volume fd94d6a2-310d-4b07-99cc-1891f68e5287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd94d6a2-310d-4b07-99cc-1891f68e5287', 'volume_size': 1} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-290365228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd94d6a2-310d-4b07-99cc-1891f68e5287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e26e52a8c79c4a46946679ef2229b702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:52Z,use_quota=True,user_id='4718c111cd07436c81d26174d8a091a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Creating volume fd94d6a2-310d-4b07-99cc-1891f68e5287 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:52 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:52 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 1073741824 Sep 01 02:24:52 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:52 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f" returned: 0 in 0.384s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:52 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e Sep 01 02:24:52 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:52 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 1073741824" returned: 0 in 0.463s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:INSERT=82,cinder:SELECT=182,cinder:UPDATE=257,cinder:DELETE=26 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:24:52 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:53 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 Sep 01 02:24:53 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:53 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e" returned: 0 in 0.389s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:53 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e Sep 01 02:24:53 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:53 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287" returned: 0 in 0.274s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773e10a5-3bd0-440f-9f11-c626f425046c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd94d6a2-310d-4b07-99cc-1891f68e5287', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036cbb33-2fda-4ca6-b927-7849d0d6c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=206,cinder:INSERT=61,cinder:UPDATE=261,cinder:DELETE=18 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:24:53 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Volume volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 (fd94d6a2-310d-4b07-99cc-1891f68e5287): created successfully Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (036cbb33-2fda-4ca6-b927-7849d0d6c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Flow 'volume_create_manager' (af4a5599-56f9-4f2c-968e-c8a0b5a92fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:53 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-44eaea41-d719-4cac-aa03-2bd92c6cc072 tempest-ProjectReaderTests-710576940 None] Created volume successfully. Sep 01 02:24:53 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f.b5935431-7dac-43e8-bbad-9b163b9d534e" returned: 0 in 0.265s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-b5935431-7dac-43e8-bbad-9b163b9d534e" released by "_delete_snapshot" :: held 1.542s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-7766a410-fd11-4972-af36-b082bf248c1f" released by "delete_snapshot" :: held 1.567s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Created reservations ['49e3e9b8-56e1-411d-81e5-9e3fc8e5ce63', '8e9978e6-b912-410f-83fe-57d4ef5e2711', 'e87da2e5-f0fc-4e24-9598-c25c08b798c0', '7c4b329e-e34d-49ae-978f-6713297cbbf9'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:53 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Delete snapshot completed successfully. Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-3ecd0201-f686-403b-9e9e-59bafcbe39f9 tempest-ProjectMemberTests-846567292 None] Lock "cinder-b5935431-7dac-43e8-bbad-9b163b9d534e-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-7766a410-fd11-4972-af36-b082bf248c1f-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Lock "cinder-7766a410-fd11-4972-af36-b082bf248c1f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:53 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Acquiring lock "cinder-quobyte-7766a410-fd11-4972-af36-b082bf248c1f" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-7766a410-fd11-4972-af36-b082bf248c1f" acquired by "delete_volume" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[546e283b-2083-47f5-9d63-52f2b1e0fdd8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f Sep 01 02:24:54 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:54 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f" returned: 0 in 0.372s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f Sep 01 02:24:54 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Creating offline snapshot 703b2479-2963-433c-9305-fe123e5be1ac of volume fd94d6a2-310d-4b07-99cc-1891f68e5287 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:24:54 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-7766a410-fd11-4972-af36-b082bf248c1f" returned: 0 in 0.274s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d27ef31-2141-49ca-a2c9-638441d1ad0b]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Lock "cinder-quobyte-7766a410-fd11-4972-af36-b082bf248c1f" released by "delete_volume" :: held 0.724s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Created reservations ['8439c1fc-46ab-477f-b270-6a5299408508', '357faac5-11de-4afc-8b1c-4e2a0f345b59', '5131edc0-0152-479c-973e-0d6dd80597a6', '55ac3eae-435a-4852-9dcb-74b73891ea1d'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:54 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 Sep 01 02:24:54 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:54 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:54 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:24:54 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:55 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287" returned: 0 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:55 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac 1G Sep 01 02:24:55 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:55 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.280s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:55 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Deleted volume successfully. Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-08472887-6cac-4f28-aab2-753f6947ffdd tempest-ProjectMemberTests-846567292 None] Lock "cinder-7766a410-fd11-4972-af36-b082bf248c1f-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:55 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac 1G" returned: 0 in 0.469s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:55 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac Sep 01 02:24:55 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:55 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac" returned: 0 in 0.333s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:55 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac is being set with open permissions: ugo+rw Sep 01 02:24:55 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:55 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac Sep 01 02:24:55 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:56 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac" returned: 0 in 0.264s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:56 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.info Sep 01 02:24:56 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:56 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.info" returned: 0 in 0.281s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:56 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.info is being set with open permissions: ugo+rw Sep 01 02:24:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:56 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.info Sep 01 02:24:56 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:56 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.info" returned: 0 in 0.279s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:56 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:56 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-9cb8eefc-1854-435f-bbf9-6104c9158c99 tempest-ProjectReaderTests-710576940 None] Create snapshot completed successfully Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-703b2479-2963-433c-9305-fe123e5be1ac-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Lock "cinder-703b2479-2963-433c-9305-fe123e5be1ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-fd94d6a2-310d-4b07-99cc-1891f68e5287" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-fd94d6a2-310d-4b07-99cc-1891f68e5287" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-703b2479-2963-433c-9305-fe123e5be1ac" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-703b2479-2963-433c-9305-fe123e5be1ac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Deleting offline snapshot 703b2479-2963-433c-9305-fe123e5be1ac of volume fd94d6a2-310d-4b07-99cc-1891f68e5287 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] snapshot_file for this snap is: volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b26aec8-f5d6-4756-ab72-cdaf82cbc505]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:57 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:58 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac Sep 01 02:24:58 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:58 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac" returned: 0 in 0.383s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:58 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd94d6a2-310d-4b07-99cc-1891f68e5287(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:58 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ade091-3880-4736-b160-dd1ecf399b3e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:58 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 Sep 01 02:24:58 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:58 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287" returned: 0 in 0.376s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:58 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:58 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac Sep 01 02:24:58 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:59 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac" returned: 0 in 0.364s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:59 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac Sep 01 02:24:59 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:59 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:59 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287.703b2479-2963-433c-9305-fe123e5be1ac" returned: 0 in 0.268s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-703b2479-2963-433c-9305-fe123e5be1ac" released by "_delete_snapshot" :: held 1.484s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-fd94d6a2-310d-4b07-99cc-1891f68e5287" released by "delete_snapshot" :: held 1.508s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:59 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Created reservations ['82511b06-38ff-4836-9c28-73aa5e732b43', 'affdead8-7e20-4510-9157-07e2b3f079fe', 'f565d263-b143-4b40-80c9-fb0be828fb09', 'ed2f1966-a4d8-4f7b-b764-9ef573cf754e'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:59 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Delete snapshot completed successfully. Sep 01 02:24:59 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-f887da40-7f19-4b9a-87e2-c2f73abc07c1 tempest-ProjectReaderTests-710576940 None] Lock "cinder-703b2479-2963-433c-9305-fe123e5be1ac-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-fd94d6a2-310d-4b07-99cc-1891f68e5287-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Lock "cinder-fd94d6a2-310d-4b07-99cc-1891f68e5287-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Acquiring lock "cinder-quobyte-fd94d6a2-310d-4b07-99cc-1891f68e5287" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-fd94d6a2-310d-4b07-99cc-1891f68e5287" acquired by "delete_volume" :: waited 0.027s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d91765-2eb4-42ed-b0b6-60eac050bf68]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:00 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 Sep 01 02:25:00 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:00 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287" returned: 0 in 0.391s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:00 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287 Sep 01 02:25:00 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:00 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-fd94d6a2-310d-4b07-99cc-1891f68e5287" returned: 0 in 0.263s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Lock "cinder-quobyte-fd94d6a2-310d-4b07-99cc-1891f68e5287" released by "delete_volume" :: held 0.713s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Created reservations ['b8f2235d-868a-4b3c-81c4-7e5edcf23b24', 'f49d7841-8e25-4466-8d0c-439f8670a165', 'e0ab5426-e60f-41d6-b54c-08bea92040db', '70ec4454-5310-4899-a9be-e6bd15e15fff'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:00 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:01 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:25:01 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:01 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:01 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.268s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:01 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:01 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Deleted volume successfully. Sep 01 02:25:01 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-fae77dcc-5868-4811-a13b-11c4c44c2d6a tempest-ProjectReaderTests-710576940 None] Lock "cinder-fd94d6a2-310d-4b07-99cc-1891f68e5287-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:06 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:25:06 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:06 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.335s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:25:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:25:10 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:UPDATE=31,cinder:DELETE=1,cinder:SELECT=21,cinder:INSERT=8 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:25:11 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:25:33 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Flow 'volume_create_manager' (87f74bcd-aa3e-4c53-a123-14a38152ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:33 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d121c9e-296a-4418-8887-bd707521f1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d121c9e-296a-4418-8887-bd707521f1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-605044245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1c0b22-258d-4413-bdba-214a7c7aeb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='befd2171c3144248bf0dea22aab4d8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:34Z,use_quota=True,user_id='3db9a7aff261416280c78e377c07f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8703ca60-e6b4-4688-8231-0e2df8ddb58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8703ca60-e6b4-4688-8231-0e2df8ddb58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdfcdc0-e3a8-4507-bd7c-9563b8b3e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fdfcdc0-e3a8-4507-bd7c-9563b8b3e131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1c0b22-258d-4413-bdba-214a7c7aeb49', 'volume_name': 'volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa122e29-22aa-4a07-b7d3-10c939af9984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa122e29-22aa-4a07-b7d3-10c939af9984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39041b2-1b44-4888-ae99-3534aef7e3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Volume ac1c0b22-258d-4413-bdba-214a7c7aeb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49', 'volume_size': 1} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-605044245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1c0b22-258d-4413-bdba-214a7c7aeb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='befd2171c3144248bf0dea22aab4d8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:34Z,use_quota=True,user_id='3db9a7aff261416280c78e377c07f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)}" {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Creating volume ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:34 devstack cinder-volume[87425]: INFO cinder.volume.drivers.remotefs [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] casted to osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 1073741824 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:34 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 1073741824 Sep 01 02:25:34 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:34 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 1073741824" returned: 0 in 0.407s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:34 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 Sep 01 02:25:34 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:34 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49" returned: 0 in 0.262s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'} {{(pid=87425) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39041b2-1b44-4888-ae99-3534aef7e3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49', 'volume_size': 1}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6be5091-4380-45cb-bc3e-8a911dff51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:34 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Volume volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 (ac1c0b22-258d-4413-bdba-214a7c7aeb49): created successfully Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6be5091-4380-45cb-bc3e-8a911dff51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:34 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Flow 'volume_create_manager' (87f74bcd-aa3e-4c53-a123-14a38152ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:34 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-99dfd2ac-ff92-4769-bd50-d24928a62bb7 tempest-SnapshotDependencyTests-1683831157 None] Created volume successfully. Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Creating offline snapshot faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef of volume ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[05451915-eb6a-4cd4-bdad-dc32006324a3]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:35 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 Sep 01 02:25:35 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:35 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49" returned: 0 in 0.363s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef 1G {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:35 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef 1G Sep 01 02:25:35 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:35 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef 1G" returned: 0 in 0.382s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:35 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:35 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef Sep 01 02:25:35 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 -F qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" returned: 0 in 0.287s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef is being set with open permissions: ugo+rw Sep 01 02:25:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:36 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef Sep 01 02:25:36 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" returned: 0 in 0.241s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:36 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.info Sep 01 02:25:36 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:36 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.info" returned: 0 in 0.245s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:36 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.info is being set with open permissions: ugo+rw Sep 01 02:25:36 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.info {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:36 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.info Sep 01 02:25:36 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:37 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.info" returned: 0 in 0.238s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:37 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-fa4fba1d-320c-475c-b73a-0a15c509569d tempest-SnapshotDependencyTests-1683831157 None] Create snapshot completed successfully Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87425) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Flow 'volume_create_manager' (9c73c670-fba3-472c-8a11-2a7dd0e99e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6355d42a-240d-4f5c-aa17-2d70281a913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6355d42a-240d-4f5c-aa17-2d70281a913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73187555-fe52-440e-a6aa-200a0dfed9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='befd2171c3144248bf0dea22aab4d8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:25:38Z,use_quota=True,user_id='3db9a7aff261416280c78e377c07f57c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ca01426-220d-4566-97fa-2c2672ceddd1),volume_type_id=2ca01426-220d-4566-97fa-2c2672ceddd1)' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1810cd0e-ba69-45c9-8285-b59ae7670633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1810cd0e-ba69-45c9-8285-b59ae7670633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37e7aa0-df89-4364-ab26-3e3d1ed2cd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37e7aa0-df89-4364-ab26-3e3d1ed2cd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73187555-fe52-440e-a6aa-200a0dfed9f1', 'volume_name': 'volume-73187555-fe52-440e-a6aa-200a0dfed9f1', 'volume_size': 1, 'snapshot_id': 'faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30a2650-df8d-4e6b-94b8-a72f105ab779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30a2650-df8d-4e6b-94b8-a72f105ab779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7723426-be1d-4bef-aa76-3f9b892d3200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:37 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Volume 73187555-fe52-440e-a6aa-200a0dfed9f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73187555-fe52-440e-a6aa-200a0dfed9f1', 'volume_size': 1, 'snapshot_id': 'faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef'} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-quobyte-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef-73187555-fe52-440e-a6aa-200a0dfed9f1" by "_create_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef-73187555-fe52-440e-a6aa-200a0dfed9f1" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Creating volume 73187555-fe52-440e-a6aa-200a0dfed9f1 from snapshot faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef {{(pid=87425) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Selected osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7 as target Quobyte volume. {{(pid=87425) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:25:37 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-quobyte-73187555-fe52-440e-a6aa-200a0dfed9f1" by "_copy_volume_from_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-73187555-fe52-440e-a6aa-200a0dfed9f1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] snapshot: faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef, volume: 73187555-fe52-440e-a6aa-200a0dfed9f1, {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c44599-d9ab-49b7-a380-d6424e76f7ab]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:38 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef Sep 01 02:25:38 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:38 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" returned: 0 in 0.348s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[64166405-6535-4a18-9ebe-319337b8fb72]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:38 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 Sep 01 02:25:38 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:38 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49" returned: 0 in 0.359s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] will copy from snapshot at /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Creating direct copy from snapshot {{(pid=87425) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG cinder.utils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Path /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 not found in is_blk_device check {{(pid=87425) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:25:38 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:38 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 Sep 01 02:25:38 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:42 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1" returned: 0 in 3.990s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:42 devstack cinder-volume[87425]: DEBUG cinder.image.image_utils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Image conversion details: src /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49, size 1024.00 MB, duration 3.99 sec, destination /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 {{(pid=87425) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:25:42 devstack cinder-volume[87425]: INFO cinder.image.image_utils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Converted 1024.00 MB image at 256.53 MB/s Sep 01 02:25:42 devstack cinder-volume[87425]: WARNING cinder.volume.drivers.remotefs [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 is being set with open permissions: ugo+rw Sep 01 02:25:42 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:42 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 Sep 01 02:25:42 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:43 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1" returned: 0 in 0.236s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-73187555-fe52-440e-a6aa-200a0dfed9f1" released by "_copy_volume_from_snapshot" :: held 5.011s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef-73187555-fe52-440e-a6aa-200a0dfed9f1" released by "_create_volume_from_snapshot" :: held 5.074s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.092s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7723426-be1d-4bef-aa76-3f9b892d3200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73187555-fe52-440e-a6aa-200a0dfed9f1', 'volume_size': 1, 'snapshot_id': 'faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef'}' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ce2972-c814-4004-92a3-f7449eb3a4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:25:43 devstack cinder-volume[87425]: INFO cinder.volume.flows.manager.create_volume [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Volume volume-73187555-fe52-440e-a6aa-200a0dfed9f1 (73187555-fe52-440e-a6aa-200a0dfed9f1): created successfully Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ce2972-c814-4004-92a3-f7449eb3a4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87425) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Flow 'volume_create_manager' (9c73c670-fba3-472c-8a11-2a7dd0e99e38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87425) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:25:43 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-ffd7c5bc-2d86-443c-aa68-4dba3325287d tempest-SnapshotDependencyTests-1683831157 None] Created volume successfully. Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef-delete_snapshot" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-quobyte-ac1c0b22-258d-4413-bdba-214a7c7aeb49" by "delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-ac1c0b22-258d-4413-bdba-214a7c7aeb49" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-quobyte-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" by "_delete_snapshot" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Deleting offline snapshot faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef of volume ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] snapshot_file for this snap is: volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef {{(pid=87425) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[6063f010-136a-45ca-ba28-dbab17bfcadb]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:43 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef Sep 01 02:25:43 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:43 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" returned: 0 in 0.352s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.remotefs [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87425) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbecf08-df15-4c19-8cba-0e0976f83b4e]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:43 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:43 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 Sep 01 02:25:43 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:44 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49" returned: 0 in 0.518s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:44 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef Sep 01 02:25:44 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:44 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" returned: 0 in 0.321s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:44 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef Sep 01 02:25:44 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:44 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:44 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49.faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" returned: 0 in 0.237s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef" released by "_delete_snapshot" :: held 1.518s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:44 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-ac1c0b22-258d-4413-bdba-214a7c7aeb49" released by "delete_snapshot" :: held 1.540s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:45 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Created reservations ['a9da266e-91c1-44ac-b2ae-496408f516e4', '80535a97-d7d1-49b6-bf58-dc74d162d117', '5298b816-452e-4f95-9bea-62e151c062a6', '8780dc25-9061-48fa-ab6d-25def5e38175'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:45 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Delete snapshot completed successfully. Sep 01 02:25:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-4ed8b7c7-e184-4b37-831f-70555a8d0249 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-faae8c8e-a3aa-47da-a7e6-625ccbd0e9ef-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-ac1c0b22-258d-4413-bdba-214a7c7aeb49-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-ac1c0b22-258d-4413-bdba-214a7c7aeb49-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-quobyte-ac1c0b22-258d-4413-bdba-214a7c7aeb49" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:45 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-ac1c0b22-258d-4413-bdba-214a7c7aeb49" acquired by "delete_volume" :: waited 0.015s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:45 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eff58f-f51c-4434-810c-e3b5d52691c8]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:45 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:45 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 Sep 01 02:25:45 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:46 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49" returned: 0 in 0.351s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:46 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49 Sep 01 02:25:46 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:46 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-ac1c0b22-258d-4413-bdba-214a7c7aeb49" returned: 0 in 0.243s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-ac1c0b22-258d-4413-bdba-214a7c7aeb49" released by "delete_volume" :: held 0.647s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Created reservations ['c36e38fa-840f-4a30-9e7e-f0c7708a6654', 'c0d3e9e2-3266-4bb0-87ae-c16e5c3bcb27', 'ea813711-e9ae-4118-8d63-9be5a6d613ef', '938775b1-0a0d-40e1-983d-51ea38a23146'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:46 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:25:46 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:46 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.248s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:46 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Deleted volume successfully. Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-61c4a0c9-dc4c-40c1-b215-88d033d517c6 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-ac1c0b22-258d-4413-bdba-214a7c7aeb49-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-73187555-fe52-440e-a6aa-200a0dfed9f1-delete_volume" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-73187555-fe52-440e-a6aa-200a0dfed9f1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "cinder-quobyte-73187555-fe52-440e-a6aa-200a0dfed9f1" by "delete_volume" {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-73187555-fe52-440e-a6aa-200a0dfed9f1" acquired by "delete_volume" :: waited 0.013s {{(pid=87425) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo.privsep.daemon [-] privsep: reply[145b6087-dc6d-4ca8-8319-60c0d1610fc9]: (4, 'qcow2') {{(pid=88909) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:25:46 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:46 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 Sep 01 02:25:46 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:47 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1" returned: 0 in 0.359s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:47 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1 Sep 01 02:25:47 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:47 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2/volume-73187555-fe52-440e-a6aa-200a0dfed9f1" returned: 0 in 0.255s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-quobyte-73187555-fe52-440e-a6aa-200a0dfed9f1" released by "delete_volume" :: held 0.650s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG cinder.quota [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Created reservations ['53ac3cbe-e787-4278-9c5e-f4fbf862176f', '88a8b6d5-207d-4052-9e0b-72fab2a0bd6f', '7b5f7006-32c5-4b2f-95cd-52b803fd8852', 'd10904fe-6b2c-4bf6-a6b5-b1b4994ed0c0'] {{(pid=87425) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:25:47 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:25:47 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:25:47 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.243s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:25:47 devstack cinder-volume[87425]: INFO cinder.volume.manager [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Deleted volume successfully. Sep 01 02:25:47 devstack cinder-volume[87425]: DEBUG cinder.coordination [None req-7b40d934-171e-4ee6-94a3-7b5062c318e7 tempest-SnapshotDependencyTests-1683831157 None] Lock "cinder-73187555-fe52-440e-a6aa-200a0dfed9f1-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87425) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:25:57 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:25:57 devstack cinder-volume[87425]: DEBUG dbcounter [-] [87425] Writing DB stats cinder:SELECT=24,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87425) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7': None} {{(pid=87425) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG cinder.volume.drivers.quobyte [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-04371a2a-c4aa-455f-8b25-b878af3f6fd7'] {{(pid=87425) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.lockutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87425) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:26:06 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2 Sep 01 02:26:06 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:26:06 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG oslo_concurrency.processutils [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/932b65196143f9478d19f352c2a008c2" returned: 0 in 0.247s {{(pid=87425) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG cinder.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Notifying Schedulers of capabilities ... {{(pid=87425) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG oslo_service.periodic_task [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] Running periodic task VolumeManager._thread_info {{(pid=87425) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread count: 28 {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:26:06 devstack cinder-volume[87425]: DEBUG cinder.volume.manager [None req-647001bc-af0a-4653-906a-6cc5188e51ad None None] thread info: [<_MainThread(MainThread, started 123943769428096)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87425) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}